What is the primary defining characteristic that distinguishes deep learning from traditional, shallow machine learning algorithms?
Select an answer to reveal the explanation.
Short Explanation
In deep learning, you use neural networks with multiple hidden layers, so the model learns features automatically from raw data instead of you hand-crafting them. That layered hierarchy is what makes it 'deep' and separates it from shallow machine learning.
Full Explanation
Deep learning is a specialized subset of machine learning based on artificial neural networks. The defining characteristic of deep learning is its deep architecture, consisting of an input layer, an output layer, and multiple successive hidden layers, often dozens or hundreds. This deep hierarchical structure enables several key capabilities: 1) Feature Hierarchy, also called representation learning: instead of relying on domain experts to manually design and extract features, such as SIFT features in computer vision or phonemes in speech recognition, deep neural networks learn representations directly from raw data, such as raw pixels or audio waveforms. 2) Hierarchical extraction: early layers of the network learn basic, low-level features, such as edges and gradients; middle layers combine these to form mid-level features, such as textures and shapes; and the deepest layers combine those mid-level representations to recognize high-level semantic concepts, such as faces, objects, and words. 3) Non-linear transformation: each layer applies non-linear activation functions, such as ReLU, allowing the network to approximate highly complex, non-linear functions. The correct statement is the one that says deep learning utilizes artificial neural networks with multiple hidden layers to automatically extract and learn hierarchical features from raw data. The statement that deep learning is restricted entirely to solving multi-class classification problems and cannot perform regression tasks is incorrect, because deep learning is widely used for regression, generative modeling, and reinforcement learning. The statement that deep learning relies on a single processing layer of neurons to maintain linear separability and fast execution times is incorrect, because single-layer networks are shallow architectures, like the original Perceptron, and cannot learn complex non-linear patterns. The statement that deep learning requires manually engineered, hand-crafted features to be defined before any training can begin is also incorrect, because manual feature engineering is a limitation of traditional machine learning that deep learning actively circumvents.