ML on Mobile
Android & WearOS | iOS & watchOS & visionOS | Web & IoT (Rust)
Machine Learning on Mobile
HummingBird Fuel
This AI-powered mobile app utilizes machine learning to analyze health data and recommend personalized microdosing schedules for medication. This has the potential to optimize medication effectiveness while minimizing side effects. Our initial focus is on using caffeine for targeted energy boosts.
Website: https://www.hummingbirdfuel.com/
Photodo
This AI-powered to-do app lives conveniently on your phone. Simply capture a photo, record a voice memo, or take a note, and Photodo's intelligent assistant swings into action. It identifies the task, sets deadlines, locates nearby assistance, and even tracks your budget. It's like having a personal AI assistant in your pocket. (Android)
Article: https://zoewave.medium.com/ai-powered-todo-app-163172f20421
DrunkWatch
This innovative system leverages your smartwatch to assess your intoxication level and determine your driving suitability. It analyzes your walking patterns, writing style (when entering a code), and bio-sensor data to make this crucial call. This showcases the combined power of the iWatch's 4-core Neural Engine, accelerometer, and bio-sensors. (watchOS / iWatch10)
Website: https://www.zoewear.com/
RxDigita
Streamlining medication management, RxDigita allows you to add meds by voice or photo (the app reads the label!), set reminders, and keep track of everything in a clear and organized list view. (Android)
Website: https://www.rxdigita.com/
AshBike
This eco-friendly e-bike service leverages your fitness data (via Apple Health and Google Fit integration). Its ML capabilities help plan routes based on your calendar schedule and reward you with NFTs for choosing sustainable transportation. (Android & iOS)
Website: https:www.ashbike.com
Self-Driving LEGO® Car
This project explores the exciting concept of creating a self-driving LEGO® car with your smartphone acting as the brains of the operation.
Design Docs:
https://zoewave.medium.com/self-driving-lego-car-concept-c3a50e72cccc
Demystifying Mobile Machine Learning
A Multi-Tool Approach
Android's & iOS ML Arsenal: Choosing the Right Tool
When it comes to Android & iOS , there's no one-size-fits-all solution for ML.
Here's a breakdown of the key options and their ideal use cases
Android
ML Kit
Perfect for quick integration. It offers user-friendly APIs and pre-built models for common tasks like face detection or text recognition. However, customization is limited.
Firebase ML
Firebase ML
Seamlessly integrates with the Firebase ecosystem, providing pre-built models for specific tasks like image labeling or language translation. Similar to ML Kit, customization options are restricted.
TensorFlow (TF) Lite
TensorFlow (TF) Lite
If high performance and complete control are your priorities, TF Lite is the way to go. It allows you to leverage custom models, but requires a solid understanding of machine learning concepts.
MediaPipe (New)
MediaPipe (New)
This newcomer simplifies complex machine learning pipelines by offering a versatile and easy-to-use framework built on top of TF Lite. For developers seeking a low-code or no-code alternative to TF Lite, MediaPipe is a great option.
Gemini Nano (New)
Gemini Nano (New)
Privacy takes center stage with Gemini Nano. This secure execution environment boasts a chat-like interface for interacting with models. However, current limitations include flexibility and device compatibility (currently only available on Pixel 8 Pro).
AI Core (New)
AI Core (New)
This hardware acceleration component complements Gemini Nano on compatible devices, further optimizing its performance.
iOS
iOS
Core ML and Create ML - A Powerful Duo
Apple's mobile ecosystem offers Core ML and Create ML for streamlined ML development on iOS:
Core ML
Core ML
The core (pun intended) of on-device machine learning in iOS apps. It acts as a bridge, allowing your app to interact with various machine learning models in a unified way. These models can be used for tasks like image classification or making predictions. Core ML empowers you to run models directly on the device, enhancing speed and privacy compared to cloud-based solutions.
Create ML
Create ML
This user-friendly tool streamlines the creation of custom machine learning models. Imagine it as a drag-and-drop interface where you provide your training data, and Create ML handles the model creation process. It's ideal for beginners or scenarios where complex models aren't required.