Convolutional networks

Let’s say you have the picture of a cute puppy. You want to classify whether it’s a picture of a puppy, of a cat, of a hippopotamus or of a giraffe.

You could train a fully connected network to solve this task:


Basic concepts in machine learning

Machine learning algorithms try to imitate the pattern between two datasets in such a way that they can use one dataset to predict the other. Specifically, supervised machine learning is useful for taking what you know as input and quickly transforming it into what you want to know. On the other hand, unsupervised learning also transforms one dataset into another, but the dataset that it transforms into is not previously known or understood. Unlike supervised learning, there is no “right answer” that you’re trying to get the model to duplicate. …


In reinforcement learning, the agent usually deals with feedback that is sequential, evaluative and sampled.

In this article, we will focus on agents that can deal with feedback that’s simultaneously sequential and evaluative. And even most humans have problems with simultaneously balancing immediate and long-term goals and the gathering and utilization of information.

  • Sequential means that your agents can receive delayed information. Delayed feedback makes it tricky to interpret the source of the feedback. Sequential feedback gives rise to the temporal credit assignment problem, which is the challenge of determining which state, action, or state-action pair is responsible for a reward.
  • Evaluative means that the feedback is only relative, because the environment is uncertain. We…

Samuele Bolotta

PhD student in Machine Learning — also interested in Neuroscience and Cognitive Science.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store