AI Hotel Concierge
Highlights
- Agentic AI pipeline setup
- Vector database storage for RAG
- Integration with Heygen via native APIs
- LLM integration for AI agent training
Challenge
The client is a US startup that approached SoftTeco with an idea to create an AI-powered virtual assistant for Cisco Webex Desk Pro devices, commonly used in hotels, airports, and similar environments. The client wanted the assistant to communicate with users via audio and video formats, thus enhancing user experience and personalization. Since the client needed strong expertise in AI development, he selected SoftTeco as a recognized AI vendor.
Ready to bring your AI vision to life?
Let’s talk about how SoftTeco can help you transform it into a high-quality, market-ready solution.
Solution
SoftTeco designed an AI-powered assistant for Cisco Webex Desk Pro that transforms the device into an intelligent customer service terminal. By supporting voice-driven conversations, the assistant provides engaging and intuitive user experience. The solution also offers secure payment processing and QR scanning features, thus enabling automation of various customer transactions. It is recommended for use in hospitality, retail, and travel industries where timely and smooth user interactions matter the most.
Tech Stack
Backend
& Frontend
React
Python
Stripe
AWS
OpenAI
How it works
We started working on the client’s idea by analyzing and estimating possible solutions and available providers for integration. As a result, we selected Heygen as a provider of AI avatars to be integrated with the Cisco Webex Desk Pro and our backend. The integration with Heygen was performed via native Heygen APIs.
Since Heygen delivered the frontend part of the solution, we were responsible for the backend development. We used Agentic AI as the base for the backend and selected Vector database as the RAG storage of choice. To connect frontend and backend, we set up an Agentic AI pipeline which interprets user queries and uses ReAct agents and RAG approach to return requests in the needed format.
The pipeline operation starts with the user query in the audio format being received by Whisper, an OpenAI transcriber that converts speech into text. The transcribed text is then sent to our pipeline and is processed by the ReAct agent with Tools. The response to the query is generated in the text format and is sent to Heygen, which transforms the text into audio and video and presents it to a user via the AI avatar. To ensure the answers are relevant and accurate, we used LLMs for model training.
In addition to voice recognition and customer service, the solution also has a card reader integration with Stripe Terminal WisePOSE and an ERP integration to retrieve services, pricing, and record completed orders. Thus, users are able to instantly pay for specific services, like room booking or purchasing an additional service. The solution is deployed on AWS for better scalability and availability and is based on the microservices architecture to ensure independent and rapid scaling.
Looking for a trusted AI development partner?
Our engineers specialize in complex integrations, real-time analytics and scalable architectures for enterprise solutions.
Results
The solution is now market-ready and is in the last stages of the pre-launch process. SoftTeco is glad to be part of such an innovative and ambitious project and we are definitely looking forward to similar challenges in the future.
