#group #voice #AI #mobileapp | ๐Ÿ—“๏ธ | May 2024 - Aug 2024 | | ------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Team | Seungho ,Youjee, Sinkee, Asim, Roohi | | Credit | -Seungho: Project management, Service planning, QA<br>-Sinkee: Back-end develop, Tech research, QA <br>-**Youjee: Service planning, UX case study, Prototype, GUI, QA**<br>-Asim: Front-end develop, Publishing, QA <br>-Loohi: Branding, GUI | | About | AI voice assistant to prevent disruptions from phone calls in everyday life. <br>after Beta test, we developed ver.1 for 4months to solve problem founded in beta. At this version, user can choose whether to take the call or let the AI automatically answer instead. and add features allowing user to use more AI. | >[!tip] Purpose > We are often interrupted by too many phone calls in our daily lives, which can distract us from what weโ€™re trying to focus on. With an AI phone secretary. An AI phone secretary can help reduce that hassle. ![](https://i.imgur.com/8irMnZq.gif) **After the Beta test,** our team found several points for improvement. When users set inbound script for their own AI, User tends to make the script simply and shortly. However, these things do not help AI take clear actions during conversations, thus we need to fixed it for various scenarios. And we need to focus on usability that usual situation when we get the phone call. **we usually choose take the phone call or not various by caller. so It need to user can choose who take the incoming call AI or User depends on caller.** <br> **Improvements after usage of beta version** โœ”๏ธ Limited interaction between AI and users โœ”๏ธ Complicated outbound/inbound script setup โœ”๏ธ User anxiety over automated AI actions โœ”๏ธ Hard to identify call types โœ”๏ธ Hard to review conversation details #### Key Features We aimed to encourage more comfortable AI use for users. Since some people may not fully trust AI to handle tasks on its own, **human oversight and quick verification are still needed.** We refined and added several features to improve user experience. **Choosing either AI or Me** Users can choose whether the AI or the user handles an incoming call. **๐Ÿ—’๏ธ Summarized Work Log** The AI summarizes the call and highlights any points that require the userโ€™s attention or feedback. **๐Ÿง  AI Tuning** Users can upload call data for AI tuning or create manual guidelines directly. The AI uses this tuning pack when receiving calls or calling back. **๐Ÿ“„ Checking Real Data** Users can review real call data from any conversation handled by the AI. They can also send direct messages to the AI to request additional actions. **๐Ÿ”› Switching During a Call** Whether the AI answers first or the user picks up directly, the system should allow seamless switching between the AI and the user at any time during the call. <br> #### User Flow For this version, **our primary focus was on incoming calls**, rather than outbound calls. ![](https://imgur.com/K6cPNah.png) #### Wire frame ![](https://i.imgur.com/RXavAYB.png) #### Interface ##### Create My AI Create your own AI and connect it for call forwarding. Call forwarding is required to enable AI features. ![](https://i.imgur.com/RfTly1Q.png) <br> ##### Choose either AI or Me when for Incoming Calls It's one of key functions of this platform. You might be want to get a call or not depends on caller. You can choose who will take the call, either AI or yourself, allowing you to answer calls selectively. we also provide AI assistant mode, which means AI take the phone automatically. ![](https://i.imgur.com/2Agr0O5.png) <br> ##### AI work log ; summarized the incoming call After each call, users can review the call history. Initially, I placed the history tab on the main screen, but it felt confusing and too similar to existing competitive apps. So I revisited the approach and introduced a **Work Log**, where the AI summarizes the call and informs the user of key points. This log clearly highlights **what the AI handled on behalf of the user** and **what actions or feedback are needed from the user**. ![](https://i.imgur.com/hDhz8a1.png) ##### AI Tuning, to improve more intelligent AI ![](https://i.imgur.com/tP3ADuQ.png) In the previous version, setting outbound and inbound scripts was a hassle, and it was difficult for users to create detailed cases for the AI. So we explored how to solve this problem and eventually discovered two new ways to set up cases. The first method is **using the call data the user already has**โ€”meaning users can create a case directly from existing call records. ![](https://i.imgur.com/tFvyuHj.png) The second method is that **user set manual directly** that look similar to previous version, however we provide more specific guide for it๐Ÿ‘‡. ![](https://i.imgur.com/je2Yddg.png) If you complete to set several manual by using my data or create manual directly, they list up on the **AI tuning screen**. There's also built in options like AI greeting and AI action, you can choose to use and edit it. ![](https://i.imgur.com/UooOaGx.png) <br> ##### Real-time Data When the AI answers a call on your behalf, you can choose to monitor the conversation between the AI and the caller in real time, depending on the situation. If youโ€™re busy or prefer not to, you can hide it. ![](https://i.imgur.com/AQxSUPA.png) <br> ##### Send DM to AI Maybe many people couldn't believe AI because it was not Me and not perfect yet. That's why we made this, ==**AI control that means you can request something or order what you want to AI when AI having conversation with caller**==. however this concept might be difficult to User, So I thought of an easy name for this function, and "DM" popped into my head. The user can request something from their AI at any time while the AI is on a call with someone. then **concept of DM makes feel user more personal and private conversation between AI and me during on the phone.** ![](https://i.imgur.com/zBv386W.png) <br> ##### Call History There are all calls in the history tab. Each data entry is marked with badges that indicate **who answered the call, whether a worklog was created, and whether AI used tuning data.** In the conversation details view, the usability options include 1)using the call data as AI tuning and 2)making a callback. ![](https://i.imgur.com/JQUM0oF.png) <br> ##### Making a Call from AI When the AI makes a callback, it references the previous call data, and the user needs to input the message they want to convey to the recipient. In addition to callbacks, outbound calls are also considered, allowing users to create tuning data in advance for specific calling situations. This feature can be particularly useful for users who need to make many calls with repetitive content. ![](https://i.imgur.com/i4NIca6.png) ![](https://i.imgur.com/UbXVMxu.png) <br> #### Design system ![](https://i.imgur.com/PdIWGNB.png) --- So, I've almost introduce all flow of the version.1 especially the function what I need the most is choosing either AI or Me. I'd like to share user feedbacks and how it could be more developed for the next version. Thanks. Previous beta version ๐Ÿ‘‰ [[Voice AI Secretary ๐Ÿ› ๏ธ Beta]] ![Uploading file...26fhb]()