AI Specialization Program

🔷 WEEK  3  Lesson 3 

Title:

Classification Models

Theme:

From Notebook Experiments → Real AI Systems

Why This Lesson Exists

Most beginners learn machine learning like this:

Load data → Train model → Accuracy → Done ✓

But real-world AI works differently.

In industry:

AI is a living system, not a one-time model.

Models must be:

built,

deployed,

watched,

repaired,

retrained continuously.

This lesson introduces production thinking — the mindset used by professional AI teams...

Learning Objectives

By the AI Specialization Program • Technical Tracks

AI Engineering & Data • Lessons

🔷 WEEK 3 Lesson 3

Title: Classification Models

Lesson Objective

By the end of this lesson, learners will:

Understand what classification models are

Learn the intuition behind logistic regression

Understand decision trees and how they split data

Understand the concept of k-Nearest Neighbors (KNN)

Learn how classification models are evaluated

Understand confusion matrix, precision, recall, and F1-score

This lesson introduces predicting categories instead of numbers.

1. What is Classification?

Classification is a type of supervised learning where the goal is to predict categories or labels.

Examples:

Email

Label

“Win money now!”

Spam

“Meeting tomorrow”

Not Spam

The model learns patterns that separate categories.

Examples of classification problems:

Spam email detection

Fraud detection

Disease diagnosis

Sentiment analysis

Image recognition

Classification answers:

Text

Copy code

Which category does this belong to?

Instead of predicting numbers like regression, classification predicts classes.

2. Logistic Regression Intuition

Despite the name, logistic regression is a classification algorithm.

It predicts the probability of a class.

Example:

Predict whether an email is spam.

Output might be:

Text

Copy code

Spam probability = 0.82

If probability > 0.5 → classify as Spam.

Logistic regression uses an S-shaped curve called the sigmoid function.

Conceptually:

Text

Copy code

Input → Sigmoid Function → Probability → Class

This allows the model to make binary decisions.

3. Decision Trees Basics

Decision Trees make decisions using if–then rules.

Example:

Text

Copy code

Is income > 50,000?

        |

      Yes

        |

Is credit score > 700?

        |

      Approve Loan

The model splits the data step by step.

Each split reduces uncertainty.

Advantages:

Easy to interpret

Works with both numeric and categorical data

No scaling required

Decision trees are often the first interpretable model engineers try.

4. k-Nearest Neighbors (KNN) Intuition

KNN makes predictions based on similar data points.

Concept:

A new data point looks at its k closest neighbors.

Example:

Text

Copy code

New point → look at 5 nearest neighbors

If most neighbors are class A, the new point becomes A.

KNN works using distance calculations.

Important idea:

Similar inputs should produce similar outputs.

However, KNN can become slow with very large datasets.

5. The Confusion Matrix

To evaluate classification models, we use a confusion matrix.

Example:

Predicted Positive

Predicted Negative

Actual Positive

True Positive

False Negative

Actual Negative

False Positive

True Negative

This matrix shows how predictions compare to reality.

From this matrix we calculate important metrics.

6. Precision, Recall, and F1 Score

Accuracy alone can be misleading.

Instead, we use better metrics.

Precision

Precision measures how many predicted positives were correct.

Text

Copy code

Precision = True Positives / (True Positives + False Positives)

Important when false alarms are costly.

Example:

Spam detection.

Recall

Recall measures how many real positives were detected.

Text

Copy code

Recall = True Positives / (True Positives + False Negatives)

Important when missing a case is dangerous.

Example:

Disease detection.

F1 Score

F1-score balances precision and recall.

Text

Copy code

F1 = 2 × (Precision × Recall) / (Precision + Recall)

This gives a single balanced metric.

7. Implementing a Classification Model in Python

Example using logistic regression.

Python

Copy code

from sklearn.linear_model import LogisticRegression

from sklearn.model_selection import train_test_split

from sklearn.metrics import classification_report

X = df[['feature1','feature2']]

y = df['label']

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2)

model = LogisticRegression()

model.fit(X_train, y_train)

predictions = model.predict(X_test)

print(classification_report(y_test, predictions))

This produces precision, recall, and F1-score.

8. Engineering Mindset for Classification

Engineers must think about:

Class imbalance

Data quality

Feature importance

Evaluation metrics

Deployment requirements

A model with high accuracy but poor recall may still fail in production.

Choosing the right metric is critical.

Mini Practical Exercise

Students should:

Load a classification dataset.

Train a logistic regression model.

Make predictions.

Generate a confusion matrix.

Calculate precision and recall.

Write a short explanation:

Which metric matters most for your problem?

Explain why.

Week 3 – Lesson 3 Outcome

Students now:

✔ Understand classification problems

✔ Understand logistic regression intuition

✔ Understand decision trees and KNN

✔ Understand confusion matrix evaluation

✔ Understand precision, recall, and F1-score

✔ Can build and evaluate a classification model

Students can now build both regression and classification ML systems.

Next:

🔷 Week 3 Lesson 4 — Model Evaluation & Overfitting

Where students learn how to diagnose why models fail and how to fix them.

3. Evaluation

Before deployment, we test performance.

Common Metrics

Problem Type

Metrics

Classification

Accuracy, Precision, Recall

Regression

MAE, RMSE

Imbalanced data

F1-score

Example

Fraud detection:

Accuracy: 95%

But fraud cases missed ❌

Hence:  Precision & Recall matter more.

Validation Split

Python

train_test_split()

Prevents overfitting.

4. Deployment

Deployment = making AI usable by real people.

The model leaves the notebook.

Deployment Forms

Web API

Mobile app

Backend service

Edge device

Dashboard integration

Simplified Flow

Text

User Input → API → Model → Prediction → Application Response

Example

AFRA platform risk scoring:

User transaction → model predicts risk → system approves or flags.

5. Monitoring (Most Ignored Step)

After deployment, performance changes.

Why?

Because the world changes.

What We Monitor

prediction accuracy

input data distribution

latency

error rates

business impact

Example

Customer behavior changes during holidays → model accuracy drops.

6. Dataset Drift (Critical Concept)

Dataset drift happens when real-world data changes over time.

Types of Drift

Data Drift

Input patterns change.

Example:

new payment methods appear.

Concept Drift

Relationship changes.

Example:

fraudsters change tactics.

Visual Idea

Text

Training Data (Past)

        ↓

Real World (Present)

        ≠

Model assumptions break

Consequence

Models silently become worse.

This is called:

Model Decay.

7.  Iteration (AI Never Finishes)

Professional AI cycle:

Text

Collect New Data

↓

Retrain Model

↓

Evaluate Again

↓

Redeploy

AI systems evolve continuously.

Production Thinking Mindset

Students move from:

❌ “I built a model.”

to

✅ “I built a system that learns over time.”

Real Industry Workflow

Text

Data Engineers → prepare pipelines

Data Scientists → build models

ML Engineers → deploy systems

Product Teams → monitor impact

Modern role: 👉 Full-stack AI thinker (what this course is training).

Mini System Architecture Example

Text

User App

   ↓

Backend API

   ↓

Feature Processing

   ↓

ML Model

   ↓

Prediction Database

   ↓

Monitoring Dashboard

Students understand AI as infrastructure.

Hands-On Concept Exercise

Students design lifecycle for:

Loan Approval AI

They must define:

Data source

Training process

Evaluation metric

Deployment method

Monitoring strategy

Retraining trigger

(No coding — system thinking.).

Common Beginner Mistakes

❌ Training once and never updating

❌ Ignoring monitoring

❌ Measuring only accuracy

❌ Deploying without validation

❌ Forgetting data versioning

Golden Rule of Production AI

Text

The hardest part of AI is not building models.

It is keeping them working.

Why This Lesson Matters Before Deep ML

Students now understand:

AI is engineering

AI is lifecycle management

AI is continuous learning systems

Deep learning later becomes meaningful because they know where models fit.

Week 2 Integration Summary

Students can now:

✓ Load and explore data (Pandas)

✓ Clean datasets systematically

✓ Build transformation pipelines

✓ Engineer meaningful features

✓ Understand full AI lifecycle

They have crossed from:

Beginner Coders → Junior AI Practitioners

Outcome Achieved

Students now understand the complete AI system lifecycle before studying advanced machine learning.

Week 3 — Introduction to Machine Learning Proper

(where models finally enter — but now students are prepared like professionals, not beginners).

Powered by Soft AI Africa | Training the Next Generation of AI Leaders in Africa.