This is a senior-design project developed by Prateek Kharangate (@kharanpv) and Sam Weese (@SamuelWeese). The end-goal of this project is to have functional game of Dungeons and Dragons that operates purely based on player interactions with multiple AI systems that will be completely responsible for narration, story-building, and world generation. Since this is an ambitious project, we have divided the project into milestones, and we would be satisfied with whatever milestone we end up completing the project to, though we will ideally strive for a complete product.
The milestones are
- Developing the AI models necessary for world generation, asset generation, and story generation.
- Creating a model Dungeons and Dragons game that can be played with a human dungeon master.
- Creating a complete Dungeons and Dragons game that has an AI dungeon master.
- Email: [email protected]
Python, C/C++, SQL, Linux, Google Cloud, HTML/CSS, JavaScript, PHP, Java, Adobe Premiere Pro, MATLAB
-
Undergraduate Research, University of Cincinnati, August 2023 - December 2023
- Works on providing application-level security against side-channel attacks by developing an application in Java to detect vulnerable C code.
-
Full-Stack Developer Intern, TrueChoicePack, January 2023 - April 2023
- Collaborated with NetSuite ERP consultants to deploy cutting-edge systems and automation solutions through scripting and workflows, resulting in a substantial boost in worker productivity and efficiency.
- Implemented comprehensive SEO strategies on the company’s websites, leading to an improvement of 40% in its search engine scores.
- Designed and developed a new subsidiary website from scratch, aligning it perfectly with the objectives of the executive board while maximizing user experience.
-
Software Engineering Intern, Payload, June 2022 - August 2022
- Worked with senior developers to optimize the Extract, Transform, Load (ETL) pipeline by implementing a highly efficient process that selectively synchronizes modified records.
- Leveraged Python scripts and API requests to seamlessly integrate Payload's Google Cloud database with its CRM platform and website, streamlining data flow across the entire system.
- Designed and implemented a robust solution to map JP Morgan Chase's transaction error codes to our system's error codes, facilitating accurate transaction processing while minimizing errors and discrepancies.
My main aim is to work on a project that hasn't been implemented prior in a capstone/senior-design setting. Ideally, it would implement bleeding-edge concepts. Moreover, the project must have some practical purpose that serves to be more than a proof-of-concept (i.e., something that can at least be expanded upon to create a deliverable project in the forseeable future). For this reason, I have chosen to work on a generative AI based project that incorporates Large Language Models (LLMs) with text-to-image models to create a Dungeons and Dragons video game; something that has not fully been realized before because of the limited abilities of previous machine learning models to create endless possibilites or scenarios to enact.
- Email: [email protected]
Python, C/C++, Linux, Ghidra, Bash
- Cyber Security Research Coop, Cryptic Vector August 2023 - Current
- Worked on SMM research for arbitrary code execution during runtime using C and UEFI
- Undergraduate Research, University of Cincinnati, April 2023 - Current
- Worked on VoMo vocal cord cancer tracking app
- Wrote live signal analysis in C++, with UI connected in Swift
- Wrote low pass filters and audio analysis for cancer deltas in vocal output
- Software Contractor, Beechwood Capital Management February 2023 - June 2023
- Developed and implemented secure digitization methods and categorization system
- Reduced overhead by streamlining company billing process using VBA, Python
- Software Developer Intern, 3dB Labs December 2020 - August 2022
- Developed and implemented CUI data storing software using OpenSSL
- Designed API and RSS connectors, both server and client side (using Qt and CURL)
- Created new timekeeping systems and software to be in accordance with DCAA Yellow Book standards
- Researched and developed embedded device to Pine phone
- Contributor, Red Team Games, May 2020 to Current
- Creator and maintainer of web frontend using CSS, HTML, Django
- Creator and arbiter of the Cards and Castles competitive scene
I am looking for a project which both is applicable and unsolved, specifically in the area of LLMs and AI. I would like to upskill in this area, and learn how to effectively use and sub divide them. I also enjoy Dungeons and Dragons, and I realize that the difficulty of creating Dungeons and dragons with AI is extremely extremely difficult. That is why I decided I wanted to work on the part to create a Dungeons and Dragons game with LLM support (chatgpt and alike), as the problem is both largely unexplored, largely applicable, and highly interesting to my hobbies. Prateek and I are skipping ahead a year to work on this project together, as we both are interested in using AI to tackle the problem of undefined and changing rulesets for generative content for Dungeons and Dragons. To scope the project a bit tighter, we are starting by attempting to generate dynamic buildings using stable diffusion for DnD. We intend to start here, as we can begin building tools for LLMs to use in later implementations. Eventually, assuming everything goes right, we intend to have a set of tools for dungeons and dragons, and a system to build worlds which plot linear, while still being generated instead of static.