10.4.5 Recurrent Neural Networks (RNNs) - Revision history

Mr. Goldstein at 01:48, 10 July 2025

2025-07-10T01:48:35Z

← Older revision		Revision as of 01:48, 10 July 2025
Line 28:		Line 28:
	* '''For Recurrent Neural Networks (RNNs):'''		* '''For Recurrent Neural Networks (RNNs):'''
	** IBM Cloud Education. "What is a recurrent neural network (RNN)?" ''IBM Blog''. Available at: [https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output. https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output.] (Look for the "How do RNNs work?" and "What are RNNs used for?" sections.)		** IBM Cloud Education. "What is a recurrent neural network (RNN)?" ''IBM Blog''. Available at: [https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output. https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output.] (Look for the "How do RNNs work?" and "What are RNNs used for?" sections.)
	** freeCodeCamp.org. "~~Recurrent~~ Neural Networks ~~(RNNs) Explained.~~" ''YouTube''. ~~(Search for introductory videos that use simple analogies~~.)		** freeCodeCamp.org. "How Deep Neural Networks Work - Full Course for Beginners" ''YouTube''. https://youtu.be/dPWYUELwIdM?si=8ufjAzYLTnFgsn4Y
	** freeCodeCamp.org. "Deep Learning Crash Course for Beginners." ''YouTube.'' https://youtu.be/VyWAvY2CF9c?si=oGLcKdSLdvDJ4iEZ		** freeCodeCamp.org. "Deep Learning Crash Course for Beginners." ''YouTube.'' https://youtu.be/VyWAvY2CF9c?si=oGLcKdSLdvDJ4iEZ

	''(Note: While these resources are for a general audience, a 7th grader might need some help understanding all the details. The goal of this bibliography is to provide starting points for further exploration.)''		''(Note: While these resources are for a general audience, a 7th grader might need some help understanding all the details. The goal of this bibliography is to provide starting points for further exploration.)''

Mr. Goldstein at 01:46, 10 July 2025

2025-07-10T01:46:33Z

← Older revision		Revision as of 01:46, 10 July 2025
Line 20:		Line 20:

	* '''For Backpropagation:'''		* '''For Backpropagation:'''
	** Brownlee, Jason. "A Gentle Introduction to Backpropagation ~~Neural Networks~~." ''Machine Learning Mastery''. Available at: ~~<nowiki>~~https://machinelearningmastery.com/a-gentle-introduction~~-to~~-backpropagation-~~neural-networks/<~~/~~nowiki>~~ (This site has many good introductory articles on machine learning concepts.)		** Brownlee, Jason. "A Gentle Introduction to Backpropagation Through Time." ''Machine Learning Mastery''. Available at: https://machinelearningmastery.com/gentle-introduction-backpropagation-time/ (This site has many good introductory articles on machine learning concepts.)
	** Simplilearn. "Backpropagation in Neural Networks" ''YouTube,''https://youtu.be/ayOOMlgb320?si=OVsWbJuxJ5xI_6Xj		** Simplilearn. "Backpropagation in Neural Networks" ''YouTube,''https://youtu.be/ayOOMlgb320?si=OVsWbJuxJ5xI_6Xj
	* '''For Convolutional Neural Networks (CNNs):'''		* '''For Convolutional Neural Networks (CNNs):'''
	** IBM Cloud Education. "What are Convolutional Neural Networks?" ''IBM Blog''. Available at: https://www.ibm.com/cloud/learn/convolutional-neural-networks (Look for the "What is CNN used for?" and "How does CNN work?" sections.)		** IBM Cloud Education. "What are Convolutional Neural Networks?" ''IBM Blog''. Available at: https://www.ibm.com/cloud/learn/convolutional-neural-networks (Look for the "What is CNN used for?" and "How does CNN work?" sections.)
	** Google AI. "~~Convolutional Neural Networks~~." ''Google's Machine Learning Crash Course''. Available at: ~~<nowiki>~~https://developers.google.com/machine-learning/~~crash~~-~~course~~/convolutional-neural-networks~~/images</nowiki> (This is a more detailed resource but has good introductory concepts.)~~		** Google AI. "Machine Learning Crash Course." https://developers.google.com/machine-learning/crash-course
			** Google AI. "ML Practicum." ''Google's Machine Learning Crash Course''. Available at: https://developers.google.com/machine-learning/practica/image-classification/convolutional-neural-networks
	* '''For Recurrent Neural Networks (RNNs):'''		* '''For Recurrent Neural Networks (RNNs):'''
	** IBM Cloud Education. "What ~~are Recurrent Neural Networks~~?" ''IBM Blog''. Available at: ~~<nowiki>~~https://www.ibm.com/~~cloud~~/~~learn~~/recurrent-neural-networks</~~nowiki>~~ (Look for the "How do RNNs work?" and "What are RNNs used for?" sections.)		** IBM Cloud Education. "What is a recurrent neural network (RNN)?" ''IBM Blog''. Available at: [https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output. https://www.ibm.com/think/topics/recurrent-neural-networks#:~:text=for%20more%20information.-,How%20RNNs%20work,the%20current%20input%20and%20output.] (Look for the "How do RNNs work?" and "What are RNNs used for?" sections.)
	** freeCodeCamp.org. "Recurrent Neural Networks (RNNs) Explained." ''YouTube''. (Search for introductory videos that use simple analogies.)		** freeCodeCamp.org. "Recurrent Neural Networks (RNNs) Explained." ''YouTube''. (Search for introductory videos that use simple analogies.)
			** freeCodeCamp.org. "Deep Learning Crash Course for Beginners." ''YouTube.'' https://youtu.be/VyWAvY2CF9c?si=oGLcKdSLdvDJ4iEZ

	''(Note: While these resources are for a general audience, a 7th grader might need some help understanding all the details. The goal of this bibliography is to provide starting points for further exploration.)''		''(Note: While these resources are for a general audience, a 7th grader might need some help understanding all the details. The goal of this bibliography is to provide starting points for further exploration.)''

Mr. Goldstein at 01:32, 10 July 2025

2025-07-10T01:32:59Z

← Older revision		Revision as of 01:32, 10 July 2025
Line 21:		Line 21:
	* '''For Backpropagation:'''		* '''For Backpropagation:'''
	** Brownlee, Jason. "A Gentle Introduction to Backpropagation Neural Networks." ''Machine Learning Mastery''. Available at: <nowiki>https://machinelearningmastery.com/a-gentle-introduction-to-backpropagation-neural-networks/</nowiki> (This site has many good introductory articles on machine learning concepts.)		** Brownlee, Jason. "A Gentle Introduction to Backpropagation Neural Networks." ''Machine Learning Mastery''. Available at: <nowiki>https://machinelearningmastery.com/a-gentle-introduction-to-backpropagation-neural-networks/</nowiki> (This site has many good introductory articles on machine learning concepts.)
	** Simplilearn. "~~What is~~ Backpropagation~~? Backpropagation Algorithm~~ in Neural Networks." ''YouTube''. ~~(Search for videos that explain it visually for beginners).~~		** Simplilearn. "Backpropagation in Neural Networks" ''YouTube,''https://youtu.be/ayOOMlgb320?si=OVsWbJuxJ5xI_6Xj
	* '''For Convolutional Neural Networks (CNNs):'''		* '''For Convolutional Neural Networks (CNNs):'''
	** IBM Cloud Education. "What are Convolutional Neural Networks?" ''IBM Blog''. Available at: ~~<nowiki>~~https://www.ibm.com/cloud/learn/convolutional-neural-networks~~</nowiki>~~ (Look for the "What is CNN used for?" and "How does CNN work?" sections.)		** IBM Cloud Education. "What are Convolutional Neural Networks?" ''IBM Blog''. Available at: https://www.ibm.com/cloud/learn/convolutional-neural-networks (Look for the "What is CNN used for?" and "How does CNN work?" sections.)
	** Google AI. "Convolutional Neural Networks." ''Google's Machine Learning Crash Course''. Available at: <nowiki>https://developers.google.com/machine-learning/crash-course/convolutional-neural-networks/images</nowiki> (This is a more detailed resource but has good introductory concepts.)		** Google AI. "Convolutional Neural Networks." ''Google's Machine Learning Crash Course''. Available at: <nowiki>https://developers.google.com/machine-learning/crash-course/convolutional-neural-networks/images</nowiki> (This is a more detailed resource but has good introductory concepts.)
	* '''For Recurrent Neural Networks (RNNs):'''		* '''For Recurrent Neural Networks (RNNs):'''

Mr. Goldstein: Created page with "=== 10.4.5 Recurrent Neural Networks (RNNs) === Imagine you're telling a story, or listening to one. The words you hear ''now'' make sense because you remember the words you heard ''just before''. If someone says, "The dog barked at the...", you expect the next word to be something like "cat," "mailman," or "stranger," not "sky." Your brain remembers the sequence of words. '''Recurrent Neural Networks (RNNs)''' are a special type of digital "brain" that are designed to..."

2025-07-10T01:09:39Z

Created page with "=== 10.4.5 Recurrent Neural Networks (RNNs) === Imagine you're telling a story, or listening to one. The words you hear ''now'' make sense because you remember the words you heard ''just before''. If someone says, "The dog barked at the...", you expect the next word to be something like "cat," "mailman," or "stranger," not "sky." Your brain remembers the sequence of words. '''Recurrent Neural Networks (RNNs)''' are a special type of digital "brain" that are designed to..."

New page

=== 10.4.5 Recurrent Neural Networks (RNNs) ===
Imagine you're telling a story, or listening to one. The words you hear ''now'' make sense because you remember the words you heard ''just before''. If someone says, "The dog barked at the...", you expect the next word to be something like "cat," "mailman," or "stranger," not "sky." Your brain remembers the sequence of words.

'''Recurrent Neural Networks (RNNs)''' are a special type of digital "brain" that are designed to handle information that comes in a sequence, where the order of things really matters. They have a "memory" of what happened before! This makes them super useful for things like:

* '''Understanding language:''' Like translating from English to Spanish, or writing a story.
* '''Predicting the next word:''' Like when your phone tries to guess what you're typing next.
* '''Analyzing music:''' Understanding melodies and rhythms.
* '''Predicting stock prices:''' Looking at past trends to guess future ones (though this is very hard!).

Here's the cool part about how RNNs remember:

* '''Looping Back:''' Unlike other digital "brains" where information only flows forward, RNNs have a special loop. This loop allows information from a previous step (like a previous word in a sentence) to be fed back into the network when it processes the ''next'' step.
* '''The "Memory" Cell:''' Think of it like a little note-taking system. When the RNN processes a piece of information, it can write a little note to itself about it. Then, when it processes the ''next'' piece of information, it can read that note. This helps it understand how the current piece of information fits with what came before.

So, when an RNN is reading a sentence, it doesn't just look at each word in isolation. It remembers the words it just read, which helps it understand the meaning of the current word and predict what might come next. This "memory" makes RNNs incredibly powerful for tasks where context and order are important.
----

=== Bibliography ===

* '''For Backpropagation:'''
** Brownlee, Jason. "A Gentle Introduction to Backpropagation Neural Networks." ''Machine Learning Mastery''. Available at: <nowiki>https://machinelearningmastery.com/a-gentle-introduction-to-backpropagation-neural-networks/</nowiki> (This site has many good introductory articles on machine learning concepts.)
** Simplilearn. "What is Backpropagation? Backpropagation Algorithm in Neural Networks." ''YouTube''. (Search for videos that explain it visually for beginners).
* '''For Convolutional Neural Networks (CNNs):'''
** IBM Cloud Education. "What are Convolutional Neural Networks?" ''IBM Blog''. Available at: <nowiki>https://www.ibm.com/cloud/learn/convolutional-neural-networks</nowiki> (Look for the "What is CNN used for?" and "How does CNN work?" sections.)
** Google AI. "Convolutional Neural Networks." ''Google's Machine Learning Crash Course''. Available at: <nowiki>https://developers.google.com/machine-learning/crash-course/convolutional-neural-networks/images</nowiki> (This is a more detailed resource but has good introductory concepts.)
* '''For Recurrent Neural Networks (RNNs):'''
** IBM Cloud Education. "What are Recurrent Neural Networks?" ''IBM Blog''. Available at: <nowiki>https://www.ibm.com/cloud/learn/recurrent-neural-networks</nowiki> (Look for the "How do RNNs work?" and "What are RNNs used for?" sections.)
** freeCodeCamp.org. "Recurrent Neural Networks (RNNs) Explained." ''YouTube''. (Search for introductory videos that use simple analogies.)

''(Note: While these resources are for a general audience, a 7th grader might need some help understanding all the details. The goal of this bibliography is to provide starting points for further exploration.)''