★Learning resources
Helpful resources about the things I am currently learning (coursework, research, language, etc). Please feel free to ask me about any of them.
NOTE: I use ★ to indicate the special usefulness, completeness, or importance for me of a resource or section.
Contents
- Computer Science
- Algorithms
- Artificial Intelligence
- Bandits
- Competitive Programming
- Computer Graphics
- Deep Learning
- Dynamic Programming
- Gaussian Processes
- Kalman Filter
- Machine Learning
- ★Markov Decision Processes (MDPs)
- Neural Networks
- Online Learning
- Optimal Transport
- Partially Observable Markov Decision Processes (POMDPs)
- Programming Languages
- Quantum Computing
- ★Reinforcement Learning
- Web Development
- Mathematics
- Languages
- Research Methodology
- Others
Computer Science
Algorithms
- BOOK Sedgewick, Algorithms (4th Edition).
- COURSE Curso de Análisis y Diseño de Algoritmos (Rolando Menchaca - IPN CIC)
Artificial Intelligence
- BOOK Russel, Artificial Intelligence: A Modern Approach
- BOOK Artificial Intelligence and Games, Yannakakis and Togelius
- COURSE CS 188 - Introduction to Artificial Intelligence, Berkeley Videos Slides
- SUMMER SCHOOL Artificial Intelligence and Games
- WEBSITE Lil’Log - Lilian Weng Blog
Bandits
- BOOK WEBSITE Bandit Algorithms
- ★DEMO Can you beat the bandit?, Ian Osband
- Interactive demo to understanding what bandits are all about. —–
Competitive Programming
Computer Graphics
Deep Learning
- BOOK Goodfellow, Deep Learning
- BOOK Nielsen, Neural Networks and Deep Learning
- BOOK Stevens, Deep Learning with Pytorch
- COURSE Canzini (NYU), Deep Learning (with PyTorch)
- TOOL: NN-SVG Publication-ready NN-architecture schematics
-
Dynamic Programming
- BOOK Bertsekas, Dynamic Programming and Optimal Control
- BOOK Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality, Second Edition
Gaussian Processes
Kalman Filter
- BOOK SECTION Bertsekas, Dynamic Programming and Optimal Control Vol I, Appendix E Kalman Filtering
- TUTORIAL KalmanFilter.NET, Kalman Filter Tutorial
- YOUTUBE Understanding Kalman Filter, MATLAB Channel
Machine Learning
- BLOGPOST An overview of gradient descent optimization algorithms
- BOOK Bishop, Pattern Recognition and Machine Learning
- BOOK Bishop, パータン認識と機械学習
- ★BOOK Hardt and Recht, Patterns, predictions, and actions: A story about machine learning
- BOOK Hastie, Elements of Statistical Learning
- BOOK Molnar, Interpretable Machine Learning
- COURSE Machine Learning (Andrew Ng - Stanford) Youtube
- COURSE パターン認識と機械学習入門 (中村晃一・東京大学)
- COURSE Statistical Machine Learning (Russ Salakhutdinov - UToronto)
- COURSE Curso de Introducción al Aprendizaje de Máquina (Ricardo Menchaca - IPN CIC)
- ★YOUTUBE ROC and AUC, Clearly Explained! (Channel: StatQuest with Josh Starmer
- LearnDataSci - Resources, Courses and Tutorials —–
★Markov Decision Processes (MDPs)
- BOOK Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming
- BOOK Feinberg, Handbook of Markov Decision Processes - Methods and Applications
- BOOK Altman, Constrained Markov Decision Processes
- CHEATSHEET MDP Cheatsheet Reference
- COURSE STP425 Stochastic Processes - Jay Talor, Arizona State University
- ★ANNOTATED BIBLIOGRAPHY on Regret Analysis of Markov Decision Processes (MDPs)
Neural Networks
- COURSE CS231n: Convolutional Neural Networks for Visual Recognition
- YOUTUBE 3Blue1Brown, Neural Networks
- TOOL: NN-SVG Publication-ready NN-architecture schematics
-
Online Learning
Optimal Transport
- BOOK Peyré, Computational Optimal Transport
- BOOK Villani, Topics in Optimal Transportation
- WEBPAGE Peyré, Code - Computational Optimal Transport
- WEBPAGE Peyré, Slides Computational Optimal Transport
- YOUTUBE Cuturi, MLSS - A primer on optimal transport part 1
- YOUTUBE Cuturi, MLSS - A primer on optimal transport part 2
- YOUTUBE Cuturi, MLSS - A primer on optimal transport part 3
Partially Observable Markov Decision Processes (POMDPs)
- BOOK Kochenderfer, Decision Making Under Uncertainty: Theory and Application
- COURSE Kochenderfer, Decision Making Under Uncertainty
- REPO AI-Toolbox https://github.com/Svalorzen/AI-Toolbox
- REPO pomdp_py A Framework to Build and Solve POMDP Problems
- WEBSITE Tutorial POMDP
Programming Languages
- BOOK Anthony Williams, 2019, C++ Concurrency in Action
- WEBSITE cppreference.com
- WEBSITE C++11 FAQ
Quantum Computing
★Reinforcement Learning
Books
- Agarwal, Reinforcement Learning: Theory and Algorithms
- Bertsekas, Reinforcement Learning and Optimal Control
- Sugiyama, Statistical Reinforcement Learning
- ★Sutton, Reinforcement Learning
- The classic reference for Reinforcement Learning. This book covers almost all topics on RL, so I would recommend it more as reference book when we want to go deeper on some topic (I prefer Courses/Videos for the first introduction to topics, but I suppose that depends on preferences)
- Szepesvari, Algorithms for Reinforcement Learning
Courses
- COURSE Berkeley - Deep RL Bootcamp (Berkeley)
- COURSE Chelsea Finn - CS 330: Deep Multi-Task and Meta Learning (Finn - Stanford)
- ★COURSE David Silver - Reinforcement Learning (Silver - UCL)
- David Silver is part of the team that created AlphaGo, and his course has been available for a long time. The course is easy to follow and David Silver makes it very entertaining.
- COURSE Nan Jiang - CS498 - Reinforcement Learning (University of Illinois at Urbana-Champaign
- ★COURSE Nan Jiang - CS598 - Statistical Reinforcement Learning (University of Illinois at Urbana-Champaign
- Course on Theory of Reinforcement Learning to understand the mathematical foundations.
- COURSE Poupart - CS885 Spring 2020 - Reinforcement Learning (Poupart - University of Waterloo)
- COURSE A Free course in Deep Reinforcement Learning from beginner to expert
- COURSE Sergey Levine - CS286: Deep Reinforcement Learning (Levine - Berkeley)
- ★EDUCATIONAL RESOURCE Spinning Up in Deep RL
- Educational Resource by OpenAI about Deep RL.
- ★SPECIALIZATION Reinforcement Learning, Martha&Adam White, University of Alberta, Coursera
- YOUTUBE Pieter Abbeel - Foundations of Deep RL
GitHub Repositories
- REPO RL Adventure - higgsfield/RL-Adventure
- REPO RL Adventure 2 - higgsfield/RL-Adventure-2
- REPO grid-world-rl - Gridkevlar1818/grid-world-rl
- REPO MiniWorld - maximecb/gym-miniworld
Libraries
- Stable Baselines 3 Repo Docs
- Reliable implementations of RL algorithms in PyTorch.
- RL Baselines3 Zoo Repo
- Training framework for Stable Baselines 3
- Stable Baselines Contrib Repo
- Implementations of latest RL algorithms in PyTorch.
- Garage Repo
- Implementations of state-of-the-art RL algorithms, including Meta-RL.
Others
- WEBSITE rl-lab.com GridWorld examples
- BLOGPOST Reproducing Deep RL - Amid Fish
- ★CHEATSHEET Reinforcement Learning Cheat Sheet
- WORKSHOP Theory of Reinforcement Learning - Simons Institute, UC Berkeley
- WORKSHOP Deep Reinforcement Learning - Simons Institute, UC Berkeley
- ★TUTORIAL Google Colab - Introduction to Reinforcement Learning - Pablo Samuel Castro
- ★TUTORIAL LearnDataSci - Reinforcement Q-Learning from Scratch in Python with OpenAI Gym
- Stable Baselines 3 Suggested RL Resources
- Danny Britz list of resources and code for RL
Web Development
- GitHub Pages
- Google Sites
- Jekyll
- Katex (Latex in the web)
Mathematics
Calculus
- BOOK Stewart, Calculus
Calculus of Variations
- BOOK Fischer, Introduction to the Calculus of Variations
- BOOK Van Brunt, The calculus of variations
- CHAPTER Strang, 7.2 Calculus of variations
- YOUTUBE Strang, Calculus of variations
Convex Optimization
- Bonnans, J. Frédéric. Convex and Stochastic Optimization. Springer International Publishing, 2019.
Differential Geometry
Information Geometry
- BOOK Amari, Methods of Information Geometry.
- TUTORIAL Information Geometry of the Probability Simplex: A Short Course
Information Theory
- BOOK Cover, Elements of Information Theory
- BOOK MacKey, Information Theory, Inference, and Learning Algorithms
- BOOK Polyanskiy, Information Theory: From Coding to Learning
- BOOK Hans and Kobayashi, Mathematics of Information and Coding
- BOOK Csiszar, Information Theory - Coding Theorems for Discrete Memoryless Systems
- BOOK Raginsky and Sason, Concentration of Measure Inequalities in Information Theory, Communications, and Coding
- BOOK Chaitin, Algorithmic Information Theory
★Linear Algebra
Books
- BOOK Axler, Linear Algebra Done Right
- Recommended in this video with recommendations for self-studying pure mathematics.
- Also recommended by a former student of my laboratory (who is a legend in my Lab).
- BOOK Strang, Introduction to Linear Algebra
- BOOK Strang, Linear Algebra and Learning from Data
- BOOK The Matrix Cookbook
Courses
- YOUTUBE James Cook (Liberty University), Linear Algebra Courses (2019,2018,2016) and others
- There is a Lecture about cosets, a topic that I could not find in the books I have for Linear Algebra
- ★YOUTUBE Strang, MIT 18.06 Linear Algebra, Spring 2005
YouTube
- ★YOUTUBE 3Blue1Brown, Essence of linear algebra
- YOUTUBE Axler, Linear Algebra Done Right
- YOUTUBE Dr Peyam - Math videos
Others
Manifolds
- YOUTUBE Topology, Manifolds & Differential Geometry
- An introduction to optimization on smooth manifolds.
Measure theory
Probability
Pure Mathematics
Real Analysis
- BOOK Abbott, Understanding analysis
- Recommended in this video with recommendations for self-studying pure mathematics.
Topology
Languages
English
★Japanese
Kansai-ben
Nara-ben
Books
- BOOK Minna no Nihongo Series
- BOOK 日本語総まとめ Nihongo soumatome series
- BOOK Genki Series
- This probably is good for Native English speakers, but otherwise I would recommend Minna no Nihongo, since it is the standard resource, has vocabulary/grammatical notes translated in many languages, and it is used in many Japanese language schools.
Software Tools
- ANDROID Kaku - Floating Japanese Dictionary (OCR)
- [ANDROID Google Translate]
- There are many features of this app, but writing Kanji on screen and using the camera for translation are two of the best ones.
- CHROME-EXTENSION Language Learning with Netflix
- CHROME-EXTENSION Language Learning with YouTube
- WINDOWS SOFTWARE Capture2Text
Webpages
- WEBPAGE Hirogaru
- WEBPAGE Minato - Japan Foundation
- WEBPAGE NHK Radio Podcast - やさしい日本語
- ★ WEBPAGE NHK World Japan - Learning Japanese
- WEBPAGE Website for Foreign Nationals as Residents to Learn Japanese Language
Research Methodology
Figures
SLIDES Preparing figures for publication and presentations
Latex
- YOUTUBE Dr. Trefor Bazett - Latex Tutorial
- Ph3 Latex Week - Handouts for using latex for research
- WEBSITE Katex
- PAPER How To Write a Paper and Format it Using LATEX
Literature Research
Presentation skills
- WEBPAGE Irasutoya - Illustrations commonly used in slides in Japan
- WEBPAGE How To Use Precision Questioning and Answering for Better Results
- WEBPAGE Beautiful AI - Software guided formatting for slides to make them look cool
Reference Management
- TUTORIAL The Best Reference Manager Setup (Zotero + ZotFile + Cloud Storage)
- WEBSITE MIT - Citation Management and Writing Tools: Home
Research Methodology
Books
- BOOK Blaxter, How to research
- BOOK Cryer, The Research Student’s Guide to Success
- BOOK Dunleavy, Authoring a PhD
- BOOK JSPS, For the sound development of science
- ★BOOK Phillips, How to Get a PhD
YouTube
- YOUTUBE James Hayton Phd
- YOUTUBE PhD Coffee Time
- YOUTUBE Shady Attia
- YOUTUBE Simon Clark
- YOUTUBE Surviving and Thriving in Higher Education
- YOUTUBE Tom Nicholas - Essay tips, PhD Vlog
Others
- SLIDES Getting a PhD (in Computer Science) - Doing Good Research
- SLIDES How to do good research, get it published in SIGKDD and get it cited!
- WEBSITE Attending an academic conference - Michael Ernst
Writing
- BOOK Hofmann, Scientific Writing and Communication
- PAPER The misuse of colour in science communication
- WEBSITE Strunk, The Elements of Style
- WEBSITE MIT - Citation Management and Writing Tools: Home
- SLIDES - Effective Written Communication: Storyboarding a Technical Report - Mya Poe
Others
Entrepreneurship
- WEBSITE Pitch Deck Template
- YOUTUBE Justin Kan - Twitch Founder (sold for $1M to Amazon), gives advice about pitch presentations, entrepreneurship, etc, in a very casual funny way
Go (board game)
- The Fundamentals of Go on 13x13
- KaTrain - Tool for analyzing and playing go with AI feedback from KataGo
Job Interview / Job Hunting
- BOOK Laakmaan, Cracking the coding interview
- BOOK Guiness, Ace the programming interview
- BOOK Mongan, Programming Interviews Exposed
- VIDEO Indeed - Job Cast: Get Hired in Tech
- WEBSITE Pramp - Practice Interviewing Skills
Personal Development
- BOOK Aprende a quererte a ti mismo, Walter riso.
- BOOK Boundaries: When to Say Yes, How to Say No to Take Control of Your Life, Henry Cloud, John Townsend.
- BOOK Meditations, Marcus Aurelius.
- BOOK The subtle art of not giving a f*ck, Mark Manson.
- ★BOOK Get out of your mind and into your life, Hayes
- This was recommended to me by my theraphist. The author is has a PhD in psychology and he is a researcher. I really recommend anyone having a hard time to give it a check, I think you will not regret it.
- COURSERA De-Mystifying Mindfulness
- WEBSITE Greater Good Science Center (GGSC). Institute in Berkeley that studies happiness.
- MAGAZINE GGSC Greater Good Magazine. Articles explaining diverse ways “science-based” ways to achieve happiness/overcome problems/etc.
- PRACTICES GGSC In Action. Guides for mindfulness practices and related practices.
- PODCAST GGSC The Science of Happiness. Podcast where interviewed people have done the practices of GGSC and tell their experience
Philosophy
- COURSERA Introduction to Philosophy, The University of Edinburgh
- COURSERA Philosophy and the Sciences: Introduction to the Philosophy of Cognitive Sciences
- YOUTUBE ContraPoints
- Mainly topics on Transgender but also on other topics based on Philosophical Thinking
- TRANSCRIPT Archives: Why I Quit Academia
- YOUTUBE The Apocalypse ContraPoints (Topic: Climate Change)
- YOUTUBE Philosophy Tube
- This is the description inside the channel: “I’m giving away a philosophy degree for free! Subscribe to learn and boost your brain power!”
- Great variety of topics including intro to famous philosophers/philosophy topics and reflections on current issues from a philosophical perspective (if I may say so)
- Foucault: Crime, Police, & Power - Philosophy Tube
- YOUTUBE Carefree Wandering
- Philosophy professor that has made some critiques of Philosophy Tube’s video. I still love Philosophy Tube videos, but these critiques are great, really on point, and bring out some very interesting concepts.
Productivity
- BOOK Allen, Getting Things Done
- BOOK Young, Ultralearning
- BOOK Oakley, A Mind For Numbers: How to Excel at Math and Science (Even If You Flunked Algebra)
- COURSE Learning how to learn(Oakley - McMaster University)
- COURSE Mindshift (Oakley - McMaster University
Sex, Gender and Orientation
- WEBSITE The Genderbread Person Visual tool to explain difference between Anatomical Sex, Gender Identity, Gender Expression and Sexual Attraction and Romantic Attraction.
- YOUTUBE Sex vs Gender vs Orientation, Psych2Go 5 minute explanation of the difference between sex, gender and orientation.
- YOUTUBE Queer, PhilosophyTube
- Reflection on queer, straight and bisexual identities, and its ambiguity.
- YOUTUBE Men, Contrapoints
- Interesting reflection on masculinity in the current age from the perspective of a transgender woman. She discusses some identity issues men have given the “toxicity” associated with masculinity, and the need to redefine it for the current age. Really recommended!
- YOUTUBE Identity After Authenticity: Abigail Thorn’s Profile, Carefree Wandering
- Interesting analysis about the coming out video of Abigail Thorn, and how identity formation works in current times.
- YOUTUBE CrossYass Podcast Podcast where the host interviews crossdresser and ask about their experience, why they do it, and what fears and problems they face. I found it insightful as an alternative perspective to gender identity and expression.
Sustainable Development Goals
Teaching
- COURSE Foundations of Teaching for Learning: Introduction
- COURSE University Teaching
- COURSE Learning to Teach Online
- COURSE Virtual Teacher Specialization