Table 3 Multivariate long-term forecasting results.
Catagory | Frequency-based | Transformer-based | Linear-based | CNN-based | RNN-based | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Models | FreMixer | FITS | FiLM | PatchTST | Autoformer | TSMixer | DLinear | TimesNet | MICN | LSTM | |||||||||||
Metric | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | |
ETTh1 | 96 | 0.360 | 0.383 | 0.374 | 0.395 | 0.388 | 0.401 | 0.370 | 0.400 | 0.449 | 0.459 | 0.361 | 0.392 | 0.375 | 0.399 | 0.384 | 0.402 | 0.421 | 0.431 | 1.044 | 0.777 |
192 | 0.398 | 0.407 | 0.407 | 0.414 | 0.443 | 0.439 | 0.413 | 0.429 | 0.500 | 0.482 | 0.404 | 0.418 | 0.405 | 0.416 | 0.436 | 0.429 | 0.474 | 0.487 | 1.217 | 0.832 | |
336 | 0.418 | 0.423 | 0.429 | 0.428 | 0.488 | 0.466 | 0.422 | 0.440 | 0.521 | 0.496 | 0.420 | 0.431 | 0.439 | 0.443 | 0.491 | 0.469 | 0.569 | 0.551 | 1.259 | 0.841 | |
720 | 0.420 | 0.449 | 0.425 | 0.446 | 0.525 | 0.519 | 0.447 | 0.468 | 0.514 | 0.512 | 0.463 | 0.472 | 0.472 | 0.490 | 0.521 | 0.500 | 0.770 | 0.672 | 1.271 | 0.838 | |
ETTh2 | 96 | 0.262 | 0.328 | 0.271 | 0.337 | 0.296 | 0.344 | 0.274 | 0.337 | 0.346 | 0.388 | 0.274 | 0.341 | 0.289 | 0.353 | 0.340 | 0.374 | 0.299 | 0.364 | 2.522 | 1.278 |
192 | 0.326 | 0.371 | 0.332 | 0.375 | 0.389 | 0.402 | 0.341 | 0.382 | 0.456 | 0.452 | 0.339 | 0.385 | 0.383 | 0.418 | 0.402 | 0.414 | 0.441 | 0.454 | 3.312 | 1.384 | |
336 | 0.351 | 0.391 | 0.354 | 0.396 | 0.418 | 0.430 | 0.329 | 0.384 | 0.482 | 0.486 | 0.361 | 0.406 | 0.448 | 0.465 | 0.452 | 0.452 | 0.654 | 0.567 | 3.291 | 1.388 | |
720 | 0.377 | 0.421 | 0.378 | 0.423 | 0.433 | 0.448 | 0.379 | 0.422 | 0.515 | 0.511 | 0.405 | 0.440 | 0.605 | 0.551 | 0.462 | 0.468 | 0.956 | 0.716 | 3.257 | 1.357 | |
ETTm1 | 96 | 0.285 | 0.330 | 0.303 | 0.345 | 0.348 | 0.367 | 0.293 | 0.346 | 0.505 | 0.475 | 0.285 | 0.339 | 0.299 | 0.343 | 0.338 | 0.375 | 0.316 | 0.362 | 0.863 | 0.664 |
192 | 0.327 | 0.355 | 0.337 | 0.365 | 0.387 | 0.385 | 0.333 | 0.370 | 0.553 | 0.496 | 0.327 | 0.365 | 0.335 | 0.365 | 0.374 | 0.387 | 0.363 | 0.390 | 1.113 | 0.776 | |
336 | 0.353 | 0.375 | 0.366 | 0.385 | 0.418 | 0.405 | 0.369 | 0.392 | 0.621 | 0.537 | 0.356 | 0.382 | 0.369 | 0.386 | 0.410 | 0.411 | 0.408 | 0.426 | 1.267 | 0.832 | |
720 | 0.401 | 0.404 | 0.416 | 0.412 | 0.479 | 0.440 | 0.416 | 0.420 | 0.671 | 0.561 | 0.419 | 0.414 | 0.425 | 0.421 | 0.478 | 0.450 | 0.481 | 0.476 | 1.324 | 0.858 | |
ETTm2 | 96 | 0.159 | 0.246 | 0.163 | 0.253 | 0.165 | 0.256 | 0.166 | 0.256 | 0.255 | 0.339 | 0.163 | 0.252 | 0.167 | 0.260 | 0.187 | 0.267 | 0.179 | 0.275 | 2.041 | 1.073 |
192 | 0.214 | 0.285 | 0.217 | 0.291 | 0.222 | 0.296 | 0.223 | 0.296 | 0.281 | 0.340 | 0.216 | 0.290 | 0.224 | 0.303 | 0.249 | 0.309 | 0.307 | 0.376 | 2.249 | 1.112 | |
336 | 0.266 | 0.320 | 0.268 | 0.326 | 0.277 | 0.333 | 0.274 | 0.329 | 0.339 | 0.372 | 0.268 | 0.324 | 0.281 | 0.342 | 0.321 | 0.351 | 0.325 | 0.388 | 2.568 | 1.238 | |
720 | 0.344 | 0.372 | 0.349 | 0.378 | 0.371 | 0.398 | 0.362 | 0.385 | 0.433 | 0.432 | 0.393 | 0.414 | 0.397 | 0.421 | 0.408 | 0.403 | 0.502 | 0.490 | 2.720 | 1.287 | |
Weather | 96 | 0.143 | 0.186 | 0.170 | 0.224 | 0.193 | 0.234 | 0.149 | 0.198 | 0.266 | 0.336 | 0.145 | 0.198 | 0.176 | 0.237 | 0.172 | 0.220 | 0.161 | 0.229 | 0.369 | 0.406 |
192 | 0.187 | 0.229 | 0.213 | 0.260 | 0.228 | 0.288 | 0.194 | 0.241 | 0.307 | 0.367 | 0.191 | 0.242 | 0.220 | 0.282 | 0.219 | 0.261 | 0.220 | 0.281 | 0.416 | 0.435 | |
336 | 0.238 | 0.270 | 0.258 | 0.295 | 0.267 | 0.323 | 0.245 | 0.282 | 0.359 | 0.395 | 0.242 | 0.280 | 0.265 | 0.319 | 0.280 | 0.306 | 0.278 | 0.331 | 0.455 | 0.454 | |
720 | 0.310 | 0.325 | 0.320 | 0.339 | 0.358 | 0.350 | 0.314 | 0.334 | 0.419 | 0.428 | 0.320 | 0.336 | 0.323 | 0.362 | 0.365 | 0.359 | 0.311 | 0.356 | 0.535 | 0.520 | |
Electricity | 96 | 0.131 | 0.223 | 0.135 | 0.231 | 0.152 | 0.267 | 0.129 | 0.222 | 0.201 | 0.337 | 0.131 | 0.223 | 0.140 | 0.237 | 0.168 | 0.272 | 0.164 | 0.269 | 0.375 | 0.437 |
192 | 0.146 | 0.236 | 0.149 | 0.244 | 0.198 | 0.379 | 0.147 | 0.240 | 0.222 | 0.334 | 0.151 | 0.246 | 0.153 | 0.249 | 0.184 | 0.289 | 0.177 | 0.285 | 0.442 | 0.473 | |
336 | 0.162 | 0.254 | 0.165 | 0.261 | 0.188 | 0.283 | 0.163 | 0.259 | 0.231 | 0.338 | 0.161 | 0.261 | 0.169 | 0.267 | 0.198 | 0.300 | 0.193 | 0.304 | 0.439 | 0.473 | |
720 | 0.201 | 0.286 | 0.204 | 0.293 | 0.236 | 0.332 | 0.197 | 0.290 | 0.254 | 0.361 | 0.197 | 0.293 | 0.203 | 0.301 | 0.220 | 0.320 | 0.212 | 0.321 | 0.980 | 0.314 | |
Traffic | 96 | 0.386 | 0.257 | 0.387 | 0.270 | 0.416 | 0.294 | 0.367 | 0.250 | 0.597 | 0.371 | 0.376 | 0.264 | 0.410 | 0.282 | 0.593 | 0.321 | 0.519 | 0.309 | 0.843 | 0.453 |
192 | 0.397 | 0.262 | 0.398 | 0.274 | 0.408 | 0.288 | 0.389 | 0.264 | 0.607 | 0.382 | 0.397 | 0.277 | 0.423 | 0.287 | 0.617 | 0.336 | 0.537 | 0.315 | 0.847 | 0.453 | |
336 | 0.410 | 0.266 | 0.410 | 0.278 | 0.425 | 0.298 | 0.398 | 0.266 | 0.623 | 0.387 | 0.413 | 0.290 | 0.436 | 0.296 | 0.629 | 0.336 | 0.534 | 0.313 | 0.853 | 0.455 | |
720 | 0.452 | 0.290 | 0.448 | 0.299 | 0.520 | 0.353 | 0.457 | 0.311 | 0.639 | 0.395 | 0.444 | 0.306 | 0.466 | 0.315 | 0.640 | 0.350 | 0.577 | 0.325 | 1.500 | 0.805 | |
\(1^{st}\) Count | 46 | 1 | 0 | 10 | 0 | 4 | 0 | 0 | 0 | 0 |