Overview of sparklyr.flint
sparklyr.flint is a sparklyr extension that aims to make Flint time series functionalities easily accessible from R.
Analyzing time series data using sparklyr.flint usually entails the following:
- Importing time series data into a Spark dataframe if it is not in Spark already
- Conversion of Spark dataframe into a TimeSeriesRDD, a time-series-aware data structure
- Analyzing the resulting TimeSeriesRDD using Flint time series functionalities – at the moment, sparklyr.flint supports most of the summarizers implemented by Flint and supports summarization of both time windows and cycles