⬅ This is the next workshop step after the step-0.

🤩 The step introduces a further basic concept of an AI Agent

• Short Term Memory

This is also know as Conversational Memory.

♻️ This step introduces the following technologies and techniques

• Apache Cassandra and/or AstraDB for persistence
• Spring AI's .chat.memory. packages
• Spring Boot Autoconfigure's Cassandra package

This step introduces a new Decorating AI Agent AiAgentSession that adds conversation history capabilities.

The prompt adds some text to tell the LLM about the history being added.

The history is stored and received through Spring AI's ChatMemory interface. Here will use here the CassandraChatMemory implementation from Spring AI.

The CassandraChatMemory automatically creates a default schema for itself. This can be configured to use a different and/or existing table if you so desire.

The default schema looks like…

CREATE TABLE ai_chat_memory (
    session_id        text,
    message_timestamp timestamp,
    user              text,
    assistant         text,
    PRIMARY KEY (session_id, message_timestamp)
  ) WITH CLUSTERING ORDER BY (message_timestamp DESC);

🔎 To see changes this step introduces use git diff workshop-step-0..workshop-step-1.

🏃🏿 Run the project like:

./mvnw clean spring-boot:run

👩‍💻 Once fixed and running, open in a browser http://localhost:8080 and ask your chatbot some questions.

Test the agents ability to remember the conversation. The conversation is bound to the Vaadin session, so it will work over different browser tabs and limited periods of time as well.

The Agent is still limited though. While is keeps memory of its interactions with you, it's only pulling knowledge its model has been trained on.

🔍 Explore and test where these limitations are.

🔍 Explore the data that's been created in AstraDB.

• Open the AstraDB console, go to the CQL Console
• Type the command cql commands

USE datastax_ai_agent ;
DESCRIBE agent_conversations ;
SELECT * FROM agent_conversations ;

💪🏽 To move on to step-2 do the following:

git switch workshop-step-2

All work is copyrighted to DataStax, Inc