Table 4 Prediction performance of various ML models in classifying patients with a decrease in EF values from their baseline versus patients whose EF values increased or no changes.

From: Prediction of left ventricular ejection fraction changes in heart failure patients using machine learning and electronic health records: a multi-site study

Site-A

 

Precision

Recall

F1-Score

AUC

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

LR

78.9

83.7

88.0

93.0

55.0

56.4

57.7

60.2

64.8

67.3

69.7

73.1

0.56

0.55

0.56

0.57

SVM

79.9

83.8

88.2

93.1

50.5

55.1

59.1

64.8

61.8

66.4

70.8

76.4

0.57

0.56

0.56

0.57

RF

79.9

84.0

88.3

92.9

52.1

53.0

59.0

62.9

63.1

64.8

70.9

74.9

0.57

0.56

0.56

0.57

XGBoost

76.8

82.1

86.8

91.8

89.8

93.6

96.4

98.5

82.7

87.6

91.3

95.0

0.54

0.55

0.55

0.54

Knn

76.7

82.5

87.4

92.0

56.9

59.5

61.5

70.4

65.6

69.3

72.1

79.9

0.50

0.52

0.53

0.52

DT

79.5

83.4

87.7

92.5

53.0

54.8

63.9

76.7

62.6

64.5

73.1

83.4

0.56

0.54

0.54

0.55

Site-B

 

Precision

Recall

F1-Score

AUC

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

LR

77.2

83.0

86.3

91.9

54.2

56.4

58.6

61.4

63.7

67.2

69.8

73.6

0.60

0.62

0.61

0.61

SVM

81.3

84.8

87.0

92.3

41.2

46.3

53.1

61.3

54.6

59.8

65.9

73.7

0.60

0.61

0.61

0.62

RF

81.2

85.0

88.2

92.7

41.9

43.8

49.2

57.4

55.3

57.5

62.7

71.1

0.60

0.61

0.61

0.63

XGBoost

72.2

78.7

83.2

89.9

78.3

83.2

86.1

91.2

74.9

80.8

84.8

90.6

0.56

0.58

0.57

0.56

Knn

73.1

79.7

84.5

90.9

55.7

57.1

59.0

63.8

63.4

65.9

69.1

74.9

0.54

0.55

0.55

0.55

DT

80.5

84.1

86.2

92.2

39.4

43.4

53.7

66.5

52.4

56.5

65.7

77.3

0.59

0.58

0.59

0.61

Site-C

 

Precision

Recall

F1-Score

AUC

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

10%

15%

20%

30%

LR

85.7

88.1

89.8

93.9

61.6

59.5

59.0

57.1

71.7

71.0

71.2

71.0

0.77

0.75

0.74

0.72

SVM

90.0

91.4

91.2

94.3

50.7

48.3

52.9

53.7

64.8

63.2

66.8

68.3

0.77

0.75

0.74

0.72

RF

85.1

87.7

90.1

94.3

60.2

59.6

58.2

55.1

70.2

71.0

70.6

69.5

0.76

0.74

0.73

0.70

XGBoost

74.0

77.7

81.3

87.7

78.4

81.4

84.9

92.7

76.3

79.4

83.0

90.1

0.74

0.73

0.71

0.68

Knn

76.7

80.7

84.2

90.0

64.3

63.3

62.1

65.6

70.1

71.0

71.6

75.9

0.69

0.68

0.66

0.63

DT

90.7

91.4

89.1

93.1

48.6

47.0

57.4

58.2

63.3

61.7

69.1

71.3

0.74

0.72

0.70

0.68