Understanding Artificial Neurons

Biological vs Artificial: Just like neurons in your brain process information from your senses, artificial neurons process data. Think of it as a tiny decision-making unit.

The Basic Concept: An artificial neuron receives inputs (like numbers or data), processes them using weights and a bias, and produces an output. It is the fundamental building block of neural networks and deep learning.

Real-World Example: Imagine deciding whether to buy a product. You consider price (input 1), quality (input 2), and reviews (input 3). Each factor has different importance (weights) to you. The neuron does the same thing with data.

What are Weights? Weights determine how much influence each input has on the final output. A larger weight means that input is more important to the decision.

Weight Values: Weights can be positive (reinforcing) or negative (inhibiting). A weight of 0 means that input has no effect at all.

What is Bias? The bias is a constant value added to the weighted sum. It shifts the activation function, making the neuron more or less likely to activate.

Why We Need Bias: Without bias, if all inputs are zero, the output would always be zero. Bias allows the neuron to activate even when inputs are small or zero.

What are Activation Functions? After calculating the weighted sum, we apply an activation function to determine the neuron's output. This introduces non-linearity and decides if the neuron "fires."

Why Non-Linearity Matters: Without activation functions, neural networks would just be complex linear equations. Activation functions allow networks to learn complex patterns.

import math

def artificial_neuron(inputs, weights, bias, activation='sigmoid'):
    # Calculate weighted sum
    weighted_sum = sum(x * w for x, w in zip(inputs, weights)) + bias
    
    # Apply activation function
    if activation == 'sigmoid':
        return 1 / (1 + math.exp(-weighted_sum))
    elif activation == 'relu':
        return max(0, weighted_sum)
    elif activation == 'step':
        return 1 if weighted_sum > 0 else 0
    elif activation == 'tanh':
        return math.tanh(weighted_sum)
    
    return weighted_sum

# Example: Rating player traits (values 0-10)
# Traits being weighted: skill, speed, power
inputs = [8.5, 7.2, 9.1]  # Player stats
weights = [0.6, 0.3, 0.1]  # Importance weights
bias = -0.5

result = artificial_neuron(inputs, weights, bias, 'sigmoid')
print(f"Player rating: {result:.4f}")
# Output close to 1.0 = GOAT status!

Interactive Learning: Adjust the inputs, weights, and bias in real-time to see how an artificial neuron works.