1. Reinforcement learningImplementation of selected reinforcement learning algorithms in Tensorflow. A3C, DDPG, REINFORCE, DQN, etc.
2. Image mosaic stitchingImplemented a pipeline for 2D image mosaic and stitching. Feature extraction & matching, Adaptive Non-Maximal Suppression (ANMS), geometric blur, RANSAC
3. Irl ImitationImplementation of Inverse Reinforcement Learning (IRL) algorithms in python/Tensorflow. Deep MaxEnt, MaxEnt, LPIRL
4. QuadrotorQuadrotor control, path planning and trajectory optimization
5. non-convexSelf-contained implementation of non-convex optimization algorithms in python. Steepest Descent, Conjugate Gradient, Newton's Method, Quasi-newton (BFGS), l-BFGS
6. seamless face replacementImplemented a pipeline for automatic face replacement in videos (without deep learning). Image morphing, triangulation, TPS, Poisson blending, etc.