SamanthaOS — AI Assistant connected to your digital ecosystem
Supabase
Supported Scenarios
- Managing my agenda based on text-input : Recap a day or week, Reschedule Events and warn participants by email, create all events based on the description of a day,…
- Drafting response to email, slack messages, messenger messages — using context from Notion, my agenda.
- Recapping unread emails, events in the agendas, Todo’s, the state of the house
- Controlling the state of the house : Playing music, turning on or off various devices,…
- Responding to specific questions by searching through emails, events, Slack messages,…
- Creating various summaries sensors for home-assistant based on the state of multiple entities
Architecture
- A NodeJS app with clients for each third-party services
- Expose an endpoint to send a message to one of the assistant, which returns the response of the OpenAI Assistant once all actions have been handled.
- Easily deployed on Vercel for a given end-user.
sequenceDiagram
participant EndUser as End User
participant NodeJSApp as Samantha NodeJS App
participant OpenAI as OpenAI Custom Assistant
EndUser->>NodeJSApp: HTTP POST message
NodeJSApp->>OpenAI: Send request to OpenAI
OpenAI->>NodeJSApp: Respond with actions to perform
NodeJSApp->>NodeJSApp: Perform Actions
NodeJSApp->>OpenAI: Send completion results of actions
OpenAI->>NodeJSApp: Respond with message
NodeJSApp->>EndUser: HTTP Response with message
Usage
- Samantha can be used via anything that support transforming speech to text, sending it to an HTTP endpoint and speaking or showing the text response: iOS Shortcut, HomeAssistant Conversation Agent.
Deployment Setup