May 29, 2024
AWS is driving enterprise AI capabilities
We drove up to the AWS Summit in Los Angeles last week - it was a one-day free conference all about Generative AI and the related products that AWS has been developing.
After the keynote and taking in some sessions, I was left with the impression that these AI tools are going to be critical to software devlopment, and business in general, going forward. There were two main use-cases that I expect to see a lot in the coming months.
RAG based help-bots
RAG (Retrieval-Augmented Generation) allows companies to set the context for LLMs to be only information that is approved and specific to that company’s use case. AWS Bedrock has a Knowledge Bases feature which makes this very straight-forward, and the Q for Business product makes it a no-code exercise. In this use case, the LLM is using its general intelligence and reasoning, but is augmeneted with context specific content which is provided by the company. This reduces hallucinations and allows the help-bot to answer questions using a company’s data securely.