com.logicalclocks.hsfs

Class FeatureGroup

java.lang.Object

com.logicalclocks.hsfs.metadata.FeatureGroupBase

com.logicalclocks.hsfs.FeatureGroup

public class FeatureGroup
extends FeatureGroupBase

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FeatureGroup.FeatureGroupBuilder

Field Summary

Fields inherited from class com.logicalclocks.hsfs.metadata.FeatureGroupBase

created, creator, description, eventTime, expectationsNames, featureGroupBaseEngine, features, featureStore, id, location, name, primaryKeys, statisticsConfig, statisticsEngine, subject, timeTravelFormat, type, utils, version

Constructor Summary

Constructors

Constructor and Description
FeatureGroup()
FeatureGroup(Boolean onlineEnabled, List<String> statisticColumns, List<String> partitionKeys, String hudiPrecombineKey, String onlineTopicName)
FeatureGroup(FeatureStore featureStore, int id)
FeatureGroup(FeatureStore featureStore, @NonNull String name, Integer version, String description, List<String> primaryKeys, List<String> partitionKeys, String hudiPrecombineKey, boolean onlineEnabled, TimeTravelFormat timeTravelFormat, List<Feature> features, StatisticsConfig statisticsConfig, String onlineTopicName, String eventTime)
FeatureGroup(Integer id, String description, List<Feature> features)

Method Summary

Modifier and Type	Method and Description
Query	asOf(String wallclockTime) Get Query object to retrieve all features of the group at a point in the past.
Query	asOf(String wallclockTime, String excludeUntil) Get Query object to retrieve all features of the group at a point in the past.
static FeatureGroup.FeatureGroupBuilder	builder()
void	commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
void	commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String,String> writeOptions)
Map<Long,Map<String,String>>	commitDetails() Return commit details.
Map<Long,Map<String,String>>	commitDetails(Integer limit) Return commit details.
Map<Long,Map<String,String>>	commitDetails(String wallclockTime) Return commit details.
Map<Long,Map<String,String>>	commitDetails(String wallclockTime, Integer limit) Return commit details.
Statistics	computeStatistics(String wallclockTime) Recompute the statistics for the feature group and save them to the feature store.
String	getAvroSchema()
List<String>	getComplexFeatures()
org.apache.avro.Schema	getDeserializedAvroSchema()
String	getEncodedAvroSchema()
String	getFeatureAvroSchema(String featureName)
Boolean	getOnlineEnabled()
String	getOnlineTopicName()
List<String>	getStatisticColumns()
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, boolean overwrite, Map<String,String> writeOptions)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, HudiOperationType operation) Commit insert or upsert to time travel enabled Feature group.
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String,String> writeOptions)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite)
void	insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Storage storage, boolean overwrite, HudiOperationType operation, Map<String,String> writeOptions)
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, Long timeout, String checkpointLocation, Map<String,String> writeOptions) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.streaming.StreamingQuery	insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, String queryName, String outputMode, boolean awaitTermination, String checkpointLocation) Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read()
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read(boolean online)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read(boolean online, Map<String,String> readOptions)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read(Map<String,String> readOptions)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read(String wallclockTime) Reads Feature group data at a specific point in time.
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	read(String wallclockTime, Map<String,String> readOptions) Reads Feature group data at a specific point in time.
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	readChanges(String wallclockStartTime, String wallclockEndTime) Deprecated.
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	readChanges(String wallclockStartTime, String wallclockEndTime, Map<String,String> readOptions) Deprecated.
void	save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData) Deprecated.
void	save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData, Map<String,String> writeOptions) Deprecated.
void	setOnlineEnabled(Boolean onlineEnabled)
void	setOnlineTopicName(String onlineTopicName)
void	setStatisticColumns(List<String> statisticColumns)
void	show(int numRows)
void	show(int numRows, boolean online)

Methods inherited from class com.logicalclocks.hsfs.metadata.FeatureGroupBase

addTag, appendFeatures, appendFeatures, computeStatistics, delete, deleteTag, filter, filter, getCreated, getCreator, getDescription, getEventTime, getExpectationsNames, getFeature, getFeatures, getFeatureStore, getId, getLocation, getName, getPrimaryKeys, getStatistics, getStatistics, getStatisticsConfig, getSubject, getTag, getTags, getTimeTravelFormat, getType, getVersion, select, selectAll, selectAll, selectExcept, selectExceptFeatures, selectFeatures, setDescription, setEventTime, setExpectationsNames, setFeatures, setFeatureStore, setId, setLocation, setName, setStatisticsConfig, setTimeTravelFormat, setType, setVersion, unloadSubject, updateDescription, updateFeatureDescription, updateFeatures, updateFeatures, updateStatisticsConfig

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FeatureGroup

public FeatureGroup(FeatureStore featureStore,
                    @NonNull
                    @NonNull String name,
                    Integer version,
                    String description,
                    List<String> primaryKeys,
                    List<String> partitionKeys,
                    String hudiPrecombineKey,
                    boolean onlineEnabled,
                    TimeTravelFormat timeTravelFormat,
                    List<Feature> features,
                    StatisticsConfig statisticsConfig,
                    String onlineTopicName,
                    String eventTime)

FeatureGroup

public FeatureGroup()

FeatureGroup

public FeatureGroup(Integer id,
                    String description,
                    List<Feature> features)

FeatureGroup

public FeatureGroup(FeatureStore featureStore,
                    int id)

FeatureGroup

public FeatureGroup(Boolean onlineEnabled,
                    List<String> statisticColumns,
                    List<String> partitionKeys,
                    String hudiPrecombineKey,
                    String onlineTopicName)

Method Detail

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read()
                                                            throws FeatureStoreException,
                                                                   IOException

Overrides:

read in class FeatureGroupBase

Throws:

FeatureStoreException

IOException

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read(boolean online)
                                                            throws FeatureStoreException,
                                                                   IOException

Throws:

FeatureStoreException

IOException

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read(Map<String,String> readOptions)
                                                            throws FeatureStoreException,
                                                                   IOException

Throws:

FeatureStoreException

IOException

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read(boolean online,
                                                                   Map<String,String> readOptions)
                                                            throws FeatureStoreException,
                                                                   IOException

Throws:

FeatureStoreException

IOException

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read(String wallclockTime)
                                                            throws FeatureStoreException,
                                                                   IOException,
                                                                   ParseException

Reads Feature group data at a specific point in time.

Parameters:

wallclockTime - point in time

Returns:

Spark DataFrame containing feature data.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

read

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> read(String wallclockTime,
                                                                   Map<String,String> readOptions)
                                                            throws FeatureStoreException,
                                                                   IOException,
                                                                   ParseException

Reads Feature group data at a specific point in time.

Parameters:

wallclockTime - point in time

readOptions - Additional read options as key-value pairs, defaults to empty Map.

Returns:

Spark DataFrame containing feature data.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

readChanges

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> readChanges(String wallclockStartTime,
                                                                          String wallclockEndTime)
                                                                   throws FeatureStoreException,
                                                                          IOException,
                                                                          ParseException

Deprecated.

`readChanges` method is deprecated. Use `asOf(wallclockEndTime, wallclockStartTime).read(readOptions)` instead.

Parameters:

wallclockStartTime - start date.

wallclockEndTime - end date.

Returns:

Spark DataFrame containing feature data.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

readChanges

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> readChanges(String wallclockStartTime,
                                                                          String wallclockEndTime,
                                                                          Map<String,String> readOptions)
                                                                   throws FeatureStoreException,
                                                                          IOException,
                                                                          ParseException

Deprecated.

`readChanges` method is deprecated. Use `asOf(wallclockEndTime, wallclockStartTime).read(readOptions)` instead.

Parameters:

wallclockStartTime - start date.

wallclockEndTime - end date.

readOptions - Additional write options as key-value pairs, defaults to empty Map.

Returns:

Spark DataFrame containing feature data.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

asOf

public Query asOf(String wallclockTime)
           throws FeatureStoreException,
                  ParseException

Get Query object to retrieve all features of the group at a point in the past. This method selects all features in the feature group and returns a Query object at the specified point in time. This can then either be read into a Dataframe or used further to perform joins or construct a training dataset.

Parameters:

wallclockTime - Datetime string. The String should be formatted in one of the following formats `%Y%m%d`, `%Y%m%d%H`, `%Y%m%d%H%M`, or `%Y%m%d%H%M%S`.

Returns:

Query. The query object with the applied time travel condition

Throws:

FeatureStoreException - FeatureStoreException

ParseException - ParseException

asOf

public Query asOf(String wallclockTime,
                  String excludeUntil)
           throws FeatureStoreException,
                  ParseException

Get Query object to retrieve all features of the group at a point in the past. This method selects all features in the feature group and returns a Query object at the specified point in time. This can then either be read into a Dataframe or used further to perform joins or construct a training dataset.

Parameters:

wallclockTime - Datetime string. The String should be formatted in one of the following formats `%Y%m%d`, `%Y%m%d%H`, `%Y%m%d%H%M`, or `%Y%m%d%H%M%S`.

excludeUntil - Datetime string. The String should be formatted in one of the following formats `%Y%m%d`, `%Y%m%d%H`, `%Y%m%d%H%M`, or `%Y%m%d%H%M%S`.

Returns:

Query. The query object with the applied time travel condition

Throws:

FeatureStoreException - FeatureStoreException

ParseException - ParseException

show

public void show(int numRows)
          throws FeatureStoreException,
                 IOException

Throws:

FeatureStoreException

IOException

show

public void show(int numRows,
                 boolean online)
          throws FeatureStoreException,
                 IOException

Throws:

FeatureStoreException

IOException

save

@Deprecated
public void save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
                      throws FeatureStoreException,
                             IOException,
                             ParseException

Deprecated.

Throws:

FeatureStoreException

IOException

ParseException

save

@Deprecated
public void save(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                             Map<String,String> writeOptions)
                      throws FeatureStoreException,
                             IOException,
                             ParseException

Deprecated.

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   Storage storage)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   boolean overwrite)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   Storage storage,
                   boolean overwrite)
            throws IOException,
                   FeatureStoreException,
                   ParseException

Throws:

IOException

FeatureStoreException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   boolean overwrite,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Throws:

FeatureStoreException

IOException

ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   HudiOperationType operation)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Commit insert or upsert to time travel enabled Feature group.

Parameters:

featureData - dataframe to be committed.

operation - commit operation type, INSERT or UPSERT.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

insert

public void insert(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                   Storage storage,
                   boolean overwrite,
                   HudiOperationType operation,
                   Map<String,String> writeOptions)
            throws FeatureStoreException,
                   IOException,
                   ParseException

Throws:

FeatureStoreException

IOException

ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
                                                                       throws org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              IOException,
                                                                              FeatureStoreException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                                                                              String queryName)
                                                                       throws org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              IOException,
                                                                              FeatureStoreException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

queryName - name of spark StreamingQuery

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                                                                              String queryName,
                                                                              String outputMode)
                                                                       throws org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              IOException,
                                                                              FeatureStoreException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

queryName - name of spark StreamingQuery

outputMode - outputMode

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                                                                              String queryName,
                                                                              String outputMode,
                                                                              boolean awaitTermination,
                                                                              Long timeout)
                                                                       throws org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              IOException,
                                                                              FeatureStoreException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

queryName - name of spark StreamingQuery

outputMode - outputMode

awaitTermination - whether or not to wait for query Termination

timeout - timeout

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                                                                              String queryName,
                                                                              String outputMode,
                                                                              boolean awaitTermination,
                                                                              String checkpointLocation)
                                                                       throws org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              IOException,
                                                                              FeatureStoreException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

queryName - name of spark StreamingQuery

outputMode - outputMode

awaitTermination - whether or not to wait for query Termination

checkpointLocation - path to checkpoint location directory

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

insertStream

@Deprecated
public org.apache.spark.sql.streaming.StreamingQuery insertStream(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                                                                              String queryName,
                                                                              String outputMode,
                                                                              boolean awaitTermination,
                                                                              Long timeout,
                                                                              String checkpointLocation,
                                                                              Map<String,String> writeOptions)
                                                                       throws FeatureStoreException,
                                                                              IOException,
                                                                              org.apache.spark.sql.streaming.StreamingQueryException,
                                                                              TimeoutException,
                                                                              ParseException

Deprecated. insertStream method is deprecated FeatureGroups. Full capability insertStream is available for StreamFeatureGroups.

insert streaming dataframe in the Feature group.

Parameters:

featureData - Spark dataframe containing feature data

queryName - name of spark StreamingQuery

outputMode - outputMode

awaitTermination - whether or not to wait for query Termination

timeout - timeout

checkpointLocation - path to checkpoint location directory

writeOptions - Additional write options as key-value pairs, defaults to empty Map.

Returns:

StreamingQuery

Throws:

org.apache.spark.sql.streaming.StreamingQueryException - StreamingQueryException

IOException - IOException

FeatureStoreException - FeatureStoreException

TimeoutException - TimeoutException

ParseException - ParseException

commitDeleteRecord

public void commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData)
                        throws FeatureStoreException,
                               IOException,
                               ParseException

Throws:

FeatureStoreException

IOException

ParseException

commitDeleteRecord

public void commitDeleteRecord(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> featureData,
                               Map<String,String> writeOptions)
                        throws FeatureStoreException,
                               IOException,
                               ParseException

Throws:

FeatureStoreException

IOException

ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails()
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Return commit details.

Returns:

commit details.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(Integer limit)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Return commit details.

Parameters:

limit - number of commits to return.

Returns:

commit details.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(String wallclockTime)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Return commit details.

Parameters:

wallclockTime - point in time.

Returns:

commit details.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

commitDetails

public Map<Long,Map<String,String>> commitDetails(String wallclockTime,
                                                  Integer limit)
                                           throws IOException,
                                                  FeatureStoreException,
                                                  ParseException

Return commit details.

Parameters:

wallclockTime - point in time.

limit - number of commits to return.

Returns:

commit details.

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

getAvroSchema

public String getAvroSchema()
                     throws FeatureStoreException,
                            IOException

Throws:

FeatureStoreException

IOException

getComplexFeatures

public List<String> getComplexFeatures()

Overrides:

getComplexFeatures in class FeatureGroupBase

getFeatureAvroSchema

public String getFeatureAvroSchema(String featureName)
                            throws FeatureStoreException,
                                   IOException

Overrides:

getFeatureAvroSchema in class FeatureGroupBase

Throws:

FeatureStoreException

IOException

getEncodedAvroSchema

public String getEncodedAvroSchema()
                            throws FeatureStoreException,
                                   IOException

Overrides:

getEncodedAvroSchema in class FeatureGroupBase

Throws:

FeatureStoreException

IOException

getDeserializedAvroSchema

public org.apache.avro.Schema getDeserializedAvroSchema()
                                                 throws FeatureStoreException,
                                                        IOException

Overrides:

getDeserializedAvroSchema in class FeatureGroupBase

Throws:

FeatureStoreException

IOException

computeStatistics

public Statistics computeStatistics(String wallclockTime)
                             throws FeatureStoreException,
                                    IOException,
                                    ParseException

Recompute the statistics for the feature group and save them to the feature store.

Parameters:

wallclockTime - number of commits to return.

Returns:

statistics object of computed statistics

Throws:

FeatureStoreException - FeatureStoreException

IOException - IOException

ParseException - ParseException

builder

public static FeatureGroup.FeatureGroupBuilder builder()

getOnlineEnabled

public Boolean getOnlineEnabled()

setOnlineEnabled

public void setOnlineEnabled(Boolean onlineEnabled)

getStatisticColumns

public List<String> getStatisticColumns()

setStatisticColumns

public void setStatisticColumns(List<String> statisticColumns)

getOnlineTopicName

public String getOnlineTopicName()

Overrides:

getOnlineTopicName in class FeatureGroupBase

setOnlineTopicName

public void setOnlineTopicName(String onlineTopicName)