Download PDF

Curriculum Vitae

Education

University of Maryland, Baltimore County
Ph.D. May 2013
B.S., Computer Science 2007

Research Interests

I am interested in a wide range of artificial intelligence research, but I primarily focus on reinforcement learning, autonomous planning, and human-agent interaction. More specifically, I have published research in learning from human-delivered reinforcement, learning from demonstration, natural language command grounding, multi-agent interaction, hierarchical action learning, and learning planning knowledge. I have contributed a large breadth of open source research tools for these topics as the creator the Brown-UMBC Reinforcement Learning and Planning Java library.

Employment

Adjunct Research ProfessorMarch 2016-Present
Brown UniversityProvidence, RI


Postdoctoral ResearcherMarch 2013-March 2016
Brown UniversityProvidence, RI


InstructorFall 2009, 2010, 2011
University of Maryland Baltimore CountyBaltimore, MD
 

Courses: Computer science 104: Problem Solving and Computer Programming; Computer Science 100: Introduction to Computer Science; TRS 201: Introduction to Unix and Linux for transfer students

Significant Software Projects

BURLAP

BURLAP is a large open-source reinforcement learning and planning Java library that I created. The library supports a wide range of different single and multi-agent problems. Algorithms included range from classic forward search planning, to value function approximation, to inverse reinforcement learning for learning from humans. Many standard domains are included and the library also includes a range of analysis and visualization tools. The library and tutorials can be found at http://burlap.cs.brown.edu.

Java Rosbridge
Java Rosbridge is a Java library for connecting Java code to Robot OS (ROS) over Rosbridge, thereby allowing arbitrary Java code run on local or remote machines to control robots that interface with ROS. The library is available at https://github.com/h2r/java_rosbridge.

BurlapCraft
BurlapCraft is a mod for the video game Minecraft that allows researchers to run AI algorithms within Minecraft, using BURLAP as the interface for implementing AI algorithms. I created BurlapCraft in conjunction with Krishna Aluru, Stefanie Tellex, and John Oberlin. BurlapCraft creates well defined state representations of the game world and provides action controllers to manipulate the Minecraft player. Along with a provided model of the world, these tools are bundled together to allow existing planning and learning algorithms developed in BURLAP to control the Minecraft player. The library is available at https://github.com/h2r/burlapcraft.

Major League Kickball 2010
This is a sports game developed for the iPhone and iPod Touch. It was available on the iTunes App Store and was released on November 11th, 2010. More information available from http://www.onesouthdesign.com/apps.html

Berserker
This is an action puzzle game developed for the iPhone and iPod Touch. It was available on the iTunes App Store and was released on December 23rd, 2009. More information available from http://www.onesouthdesign.com/apps.html

QuickStat
This is a fast light weight statistical program for the iPhone/iPod Touch. Users are able to quickly enter data for 2 variables and various statistical tests are computed for the data in real time. This program was released for sale at the iTunes App Store on March 4th, 2009.

Primer Match
Program to assist in localizing forward and reverse DNA/RNA primer matches in large DNA sequences.

IRB/Regulatory Deadline Database
A database for the Division of Allergy and Clinical Immunology at Johns Hopkins to track various regulatory deadlines for human subjects research projects.

Publications

Scholarships and Awards