Billify
Billifys focus lies on digitizing receipts. You just take a picture of your receipt and Billify stores all important data in a unified format for you, so you can organize them and keep track of your spendings. Billify functions also as a simple bill splitting app that allows you to split bills with friends and family and allows you to keep track of who owes you money and who you owe money to.
Technologies
Billify is a React Native based app that uses a Nest.js backend and a MongoDB database. We developed a functioning prototype for both iOS and Android. The digitalization of receipts is done via a combination of Tesseract OCR to extract the text from the initial image and Open AI's GPT-3.5 to extract and structure the needed information. During the process of developing this app I also made tests with Open AI's GPT-4 Vision and Google's Gemini. These models overall performance was way better, but at the time of development, the cost of multimodal models was only affordable for testing purposes.
Takeaways
This project was a great opportunity to get an insight in mobile development and to work with AI models. While having to only develop a single app for both iOS and Android is convenient, React Native also brought many time consuming challanges.
Credits
UI/UX Team
Ines Freisitzer
Can Korkmaz
Eva Kuttnig
Frontend Development
Tobias Pfeil
Elisabeth Schuhmann
Eva Kuttnig
Backend Development
Elisabeth Schuhmann
Tobias Pfeil