What does an early layer find?
- Final object names
- Edges and corners for later layers
- The training schedule
What slides across the image in a convolution?
- One small filter reusing the same weights
- A new random filter per pixel
- The whole photo at once
Weight sharing assumes an edge means the same thing anywhere.
Circle one: True False
What is a feature map?
- A map of the classroom
- A picture of where one pattern was found
- A list of passwords
Why must a sequence model carry memory forward?
- So words print in bold
- So word order can change the meaning
- So sentences get shorter
Beyond layers, what does a deep model need?
- Lots of data and hardware with many cores
- A bigger monitor
- Louder fans
Every training sentence gets its words shuffled. What fails?
- The alphabet itself
- Order meaning, since memory now carries noise
- The power supply
A team wires every pixel with its own weights for photos. What breaks?
- Photos become sharper for free
- Training needs zero data
- The same edge is relearned at every spot
Match the net to the data W1-mt_karzGN5JnI-s1
- Edges and corners for later layers · Early layers catch simple patterns that deeper layers combine.
- One small filter reusing the same weights · One filter travels everywhere, which is exactly weight sharing.
- True · That assumption is why one filter can serve every position.
- A picture of where one pattern was found · Each sweep paints where its pattern appeared across the image.
- So word order can change the meaning · Order carries meaning only if earlier words travel along.
- Lots of data and hardware with many cores · Scale in data and parallel hardware is what made depth work.
- Order meaning, since memory now carries noise · Memory of scrambled words teaches order that is not there.
- The same edge is relearned at every spot · Without sharing, each position pays full tuition for the same lesson.