时间序列数据是在固定时间间隔内收集的观测序列。这些数据可以来自于任何领域，如金融、经济、健康和环境科学。我们收集的时间序列数据有时可能具有不同的频率或分辨率，这可能不适合我们的分析和数据建模过程。在这种情况下，我们可以通过上采样或下采样来重新采样时间序列数据，从而改变时间序列的频率或分辨率。本文将介绍不同的方法来上采样或下采样时间序列数据。
upsampling
upsampling means increasing the frequency of the time series data. this is usually done when we need a higher resolution or more frequent observations. python provides several methods for upsampling time series data, including linear interpolation, nearest neighbor interpolation, and polynomial interpolation.
syntax
dataframe.resample(rule, *args, **kwargs) dataframe.asfreq(freq, method=none) dataframe.interpolate(method='linear', axis=0, limit=none, inplace=false, limit_direction='forward', limit_area=none)
在这里，
-
the resample function is a method provided by the pandas library to resample time series data. it is applied on a dataframe and takes the rule parameter, which specifies the desired frequency for resampling. additional arguments (*args) and keyword arguments (**kwargs) can be provided to customize the resampling behavior, such as specifying the aggregation method or handling missing values.
-
the asfreq method is used in conjunction with the resample function to convert the frequency of the time series data. it takes the freq parameter, which specifies the desired frequency string for the output. the optional method parameter allows specifying how to handle any missing values introduced during the resampling process, such as forward filling, backward filling, or interpolation.
-
插值方法用于填充时间序列数据中的缺失值或间隙。它根据指定的方法（例如'linear'、'nearest'、'spline'）进行插值，以估计现有观测值之间的值。额外的参数可以控制插值的轴，连续nan值的填充限制，以及是否在原地修改dataframe或返回一个新的dataframe。
线性插值
线性插值用于上采样时间序列数据。它通过在数据点之间绘制直线来填充间隙。可以使用pandas库中的resample函数实现线性插值。
example
的中文翻译为：示例
in the below example, we have a time series dataframe with three observations on non−consecutive dates. we convert the 'date' column to a datetime format and set it as the index. the resample function is used to upsample the data to a daily frequency ('d') using the asfreq method. finally, the interpolate method with the 'linear' option fills the gaps between the data points using linear interpolation. the dataframe, df_upsampled, contains the upsampled time series data with interpolated values.
import pandas as pd
# create a sample time series dataframe
data = {'date': ['2023-06-01', '2023-06-03', '2023-06-06'],
'value': [10, 20, 30]}
df = pd.dataframe(data)
df['date'] = pd.to_datetime(df['date'])
df.set_index('date', inplace=true)
# upsample the data using linear interpolation
df_upsampled = df.resample('d').asfreq().interpolate(method='linear')
# print the upsampled dataframe
print(df_upsampled)
输出
value date 2023-06-01 10.000000 2023-06-02 15.000000 2023-06-03 20.000000 2023-06-04 23.333333 2023-06-05 26.666667 2023-06-06 30.000000
最近邻插值
nearest neighbor interpolation is a simple method that fills the gaps between data points with the nearest available observation. this method can be useful when the time series exhibits abrupt changes or when the order of observations matters. the interpolate method in pandas can be used with the 'nearest' option to perform nearest neighbor interpolation.
example
的中文翻译为：示例
in the above example, we use the same original dataframe as before. after resampling with the 'd' frequency, the interpolate method with the 'nearest' option fills the gaps by copying the nearest available observation. the resulting dataframe, df_upsampled, now has a daily frequency with the nearest neighbor interpolation.
import pandas as pd
# create a sample time series dataframe
data = {'date': ['2023-06-01', '2023-06-03', '2023-06-06'],
'value': [10, 20, 30]}
df = pd.dataframe(data)
df['date'] = pd.to_datetime(df['date'])
df.set_index('date', inplace=true)
# upsample the data using nearest neighbor interpolation
df_upsampled = df.resample('d').asfreq().interpolate(method='nearest')
# print the upsampled dataframe
print(df_upsampled)
输出
value date 2023-06-01 10.0 2023-06-02 10.0 2023-06-03 20.0 2023-06-04 20.0 2023-06-05 30.0 2023-06-06 30.0
下采样
降采样用于降低时间序列数据的频率，通常用于获得数据的更广泛视图或简化分析。python提供了不同的降采样技术，例如在指定的时间间隔内取均值、求和或最大值。
syntax
dataframe.mean(axis=none, skipna=none, level=none, numeric_only=none, **kwargs)
在这里，聚合方法，如均值、和或最大值，在重新采样后应用于计算代表每个重新采样间隔内分组观测的单个值。这些方法通常在降采样数据时使用。它们可以直接应用于重新采样的dataframe，也可以与重新采样函数结合使用，根据特定的频率（如每周或每月），通过指定适当的规则来聚合数据。
mean downsampling
的中文翻译为：平均下采样
均值降采样计算每个间隔内数据点的平均值。这种方法在处理高频数据并获得每个间隔的代表性值时非常有用。可以使用resample函数结合mean方法来执行均值降采样。
example
的中文翻译为：示例
in the below example, we start with a daily time series dataframe spanning the entire month of june 2023. the resample function with the 'w' frequency downsamples the data to weekly intervals. by applying the mean method, we obtain the average value within each week. the resulting dataframe, df_downsampled, contains the mean-downsampled time series data.
import pandas as pd
# create a sample time series dataframe with daily frequency
data = {'date': pd.date_range(start='2023-06-01', end='2023-06-30', freq='d'),
'value': range(30)}
df = pd.dataframe(data)
df.set_index('date', inplace=true)
# downsampling using mean
df_downsampled = df.resample('w').mean()
# print the downsampled dataframe
print(df_downsampled)
输出
value date 2023-06-04 1.5 2023-06-11 7.0 2023-06-18 14.0 2023-06-25 21.0 2023-07-02 27.0
maximum downsampling
最大降采样计算并设置每个间隔内的最高值。此方法适用于识别时间序列中的峰值或极端事件。在前面的示例中使用max而不是mean或sum允许我们执行最大降采样。
example
的中文翻译为：示例
in the below example, we start with a daily time series dataframe spanning the entire month of june 2023. the resample function with the 'w' frequency downsamples the data to weekly intervals. by applying the max method, we obtain the maximum value within each week. the resulting dataframe, df_downsampled, contains the maximum-downsampled time series data.
import pandas as pd
# create a sample time series dataframe with daily frequency
data = {'date': pd.date_range(start='2023-06-01', end='2023-06-30', freq='d'),
'value': range(30)}
df = pd.dataframe(data)
df.set_index('date', inplace=true)
# downsampling using mean
df_downsampled = df.resample('w').max()
# print the downsampled dataframe
print(df_downsampled)
输出
value date 2023-06-04 3 2023-06-11 10 2023-06-18 17 2023-06-25 24 2023-07-02 29
结论
在本文中，我们讨论了如何使用python对时间序列数据进行重新采样。python提供了各种上采样和下采样技术。我们探讨了线性和最近邻插值用于上采样，以及均值和最大值插值用于下采样。您可以根据手头的问题使用任何一种上采样或下采样技术。
