Skip to content

Copilot/integrate chat agentic systems#770

Open
Flynn013 wants to merge 239 commits into
google-ai-edge:mainfrom
Flynn013:copilot/integrate-chat-agentic-systems
Open

Copilot/integrate chat agentic systems#770
Flynn013 wants to merge 239 commits into
google-ai-edge:mainfrom
Flynn013:copilot/integrate-chat-agentic-systems

Conversation

@Flynn013
Copy link
Copy Markdown

No description provided.

Flynn013 and others added 30 commits April 13, 2026 21:09
This workflow automates the build process for the CLU-BOX Sovereign application, including theme overrides and UI modifications.
…lidation, shared NeonTextField

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/dfaf2915-16a9-41f9-99f1-5e9ee3fd1b35

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ider, rewrite CI workflows

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/e1ddeb40-ae87-4a95-af76-7fe26b4dc3bc

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
… in main.yml

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/e1ddeb40-ae87-4a95-af76-7fe26b4dc3bc

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…m KSP to KAPT

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/848259c3-0243-49c2-8e8d-4091beb4fe43

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Fix Android build: switch Moshi codegen to KAPT, correct kotlin-reflect version
…Room

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…in compile error at line 459

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/b5d30039-87a3-4fc2-b798-b6fdefbd43a6

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…heap, add --info to CI

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/20480746-b383-48c5-b708-2402b24e03fc

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…der conflict

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/96249537-cb4b-4a46-89f5-80b64cad906b

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…etadata parse failure

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/7efdc192-c5b0-42c3-abaa-492e3405eca4

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…atus bar padding

Phase 1: Remove boilerplate from HomeScreen.kt
- Remove 'App title and intro text' Column (AppTitle/AppTitleGm4/IntroText/TryGm4IntroText)
- Remove animated background star graphic (Google AI Edge Gallery brand element)
- Suppress 'Try Gemma 4 today' cards and 'Explore other use cases' header in TaskList
- Clean up now-unused imports (BlurredEdgeTreatment, blur, ColorFilter, ContentScale, requiredWidth)

Phase 2: CLU/Box Utility Dock already implemented in GalleryApp.kt
- ModalNavigationDrawer with 6 modules: CHAT_BOX, BRAIN_BOX, THE_GRID, SKILL_BOX,
  VENDING_MACHINE, SYS_SETTINGS (verified - no changes needed)

Phase 3: Fix status bar padding bug in GalleryApp.kt
- Add windowInsetsPadding(WindowInsets.statusBars) to top bar Row so menu/title
  are not covered by the Android system status bar on edge-to-edge display

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/7dd19c9e-4a4b-42ce-ad1e-1b7d7835ea25

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…X, GlobalModelManager as Vending Machine, Agent Chat for Skill Box

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/378b7fd7-a8e7-4d91-91f9-bccbf22c1cb5

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…er; delete dead screen files

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/af1e35de-ebe5-46b3-b506-ab54123e1ea7

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/86ff49b5-ed8c-4919-9323-9b92a497ae13

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ter, null stream handling

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/fdb69e0b-4f38-4db9-9653-056bf5c83968

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ration, UI, and RAG graph traversal

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/bea9ea65-2222-467b-906a-a402d4a9b17c

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Copilot AI and others added 29 commits April 27, 2026 05:40
…ark UI theme

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/30020e53-e0a2-4468-b6f1-51287f51217a

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…PT2 resource linking failure

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/3133db02-1ac5-4f47-9556-bdcea9f793ce

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
… modules

- Add AgentEngine enum (LOCAL/CLOUD) referenced by AgentChatTaskModule
- Add AgentGovernor data class with maxLoops and constraint string companions
- Rewrite AgentTools from broken object to proper class with:
  - Channel<Any> actionChannel for Compose event dispatch
  - @Tool-annotated methods: shellExecute, fileBoxWrite, fileBoxReadLines, brainBoxGrep
  - skillRegistry, governor, engine, skillManagerViewModel properties
- Fix AgentChatTaskModule: null-safe skillManagerViewModel access via local val
- Create LlmChatViewModelBase abstract class shared by three LLM chat view models
- Rewrite LlmChatViewModel with full @hiltviewmodel implementation:
  - Injects DataStoreRepository, ChatHistoryDao, BrainBoxDao
  - Implements generateResponse with streaming, chat history persistence
  - Implements wipeGrid, loadChatHistory, forgeNeuron, resetSession, stopResponse
- Add LlmAskImageViewModel and LlmAskAudioViewModel as thin Hilt subclasses
- Add REQUEST_IGNORE_BATTERY_OPTIMIZATIONS permission to AndroidManifest.xml

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…mments)

- Extract NEURON_LABEL_MAX_CHARS = 80 constant in LlmChatViewModel
- Add comment explaining MAX_TOOL_OUTPUT_CHARS = 3000 limit in AgentTools
- Add comment explaining maxLoops = 25 default in AgentGovernor

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ation errors

- Create AgentEngine enum (LOCAL/CLOUD)
- Create AgentGovernor data class with circuit-breaker maxLoops and engine constraint strings
- Rewrite AgentTools from stub object to proper class with @tool methods (shellExecute, fileBoxWrite, fileBoxReadLines, brainBoxGrep), path traversal guards, context injection, channel-based action dispatch
- Create LlmChatViewModelBase abstract class extending ChatViewModel
- Rewrite LlmChatViewModel as @hiltviewmodel with streaming inference, chat history persistence via ChatHistoryDao, forgeNeuron via BrainBoxDao, resetSession, stopResponse, runAgain
- Add LlmAskImageViewModel and LlmAskAudioViewModel as Hilt subclasses
- Fix AgentChatTaskModule to null-safe access skillManagerViewModel
- Phase 1: add TodoSkill (file-backed checklist) and DelegateSkill (agentic loop delegation), register both in SkillRegistry
- Phase 6: add REQUEST_IGNORE_BATTERY_OPTIMIZATIONS to AndroidManifest.xml

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/d7720dcc-7ad0-4cd2-809b-b5e58d3632e5

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ntGovernor.kt

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/d7720dcc-7ad0-4cd2-809b-b5e58d3632e5

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
- Rewrite Analytics.kt: replace Firebase analytics with null no-op stub
  so all firebaseAnalytics?.logEvent(...) calls silently no-op
- GalleryApplication.kt: remove FirebaseApp import and initializeApp call
- MainActivity.kt: remove FirebaseAnalytics import, bundleOf import,
  and the onResume logEvent(APP_OPEN) block
- Delete FcmMessagingService.kt
- AndroidManifest.xml: remove GalleryFcmMessagingService block and
  firebase messaging default_notification_channel_id meta-data
- Remove firebaseAnalytics imports and logEvent call blocks from:
  MobileActionsScreen, SkillManagerBottomSheet, AgentChatScreen,
  GalleryNavGraph, BenchmarkScreen, LlmChatScreen, LlmSingleTurnScreen,
  ClickableLink, DownloadRepository
- Delete legacy UI files: PromoScreenGm4, NewReleaseNotification,
  PromoBannerGm4, AICoreAccessPanel
- GlobalModelManager: remove PromoBannerGm4 composable call and its
  showPromo/promoId state variables
- ModelItem: remove AICoreAccessPanel if-block and clean up now-unused
  isDownloadFailed variable and ModelDownloadStatusType import

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Phase 7: Delete Analytics.kt; remove Firebase/GMS telemetry from AndroidManifest
Phase 5: neonGreen → #39FF14, terminalMidGrey → #121212
Phase 6: MemoryWarning — observeSwapPressure() flow, isSwapPressureCritical()
Phase 1: IntentHandler — handleSkillAction() routes tool calls via SkillRegistry
Phase 4: SkillRegistry — isEnabled gating in dispatch(); disabled skill schema
         filtering in buildFinalSystemPrompt() via proper JSONObject parsing
Phase 3: MessageBodyCollapsableProgressPanel — auto-expand on inProgress,
         show 'Ran X Actions' title when collapsed after completion

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/62041611-534e-474a-967e-27cb371db57b

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Without extractNativeLibs=true and useLegacyPackaging=true, AGP leaves
.so files compressed inside the APK. ProcessBuilder cannot execute them,
so the PRoot session receives SIGKILL (-9) immediately on startup before
any shell command runs. These two flags force the package manager to
physically extract all JNI libs to nativeLibraryDir with execute
permission, which is what NativeShellBridge requires.

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/d185acde-d308-4e44-94d4-592919fba074

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ings, GAEG eradication

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/4ea51a03-cb11-4feb-8c98-d527d121ec39

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…Manager tagFilters doc

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/4ea51a03-cb11-4feb-8c98-d527d121ec39

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…Skill, shell engine toggle

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/6ac7add8-d95e-47c4-a354-fbb3dba7e550

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ontextWindowPager, DelegateSkill SCDL_BOX wiring

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/faea9e24-5dba-4061-a7d3-3d4e8e8c48c5

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/faea9e24-5dba-4061-a7d3-3d4e8e8c48c5

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…n minimum interval

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/66174dd4-ce93-4e0a-9984-3a40b68f5ec3

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ash_screen_animated_icon.xml

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/e9e97adc-7749-4d6a-9a2b-5ae6945cd722

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…rors) and harden MCP layer

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/930c41af-974d-497a-bf00-c27575cacacd

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ng dedup, sandbox note)

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/165560ec-7b30-4737-bb3f-87ca297ddc94

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…ad of non-existent 15.6.0

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/3cae790b-d7ee-4710-b8c7-c56e2d9131f2

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…aging DSL compile error

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/bf7ee024-806d-41d1-9ab1-aee32ecbdbe3

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…work around Chaquopy's BaseExtension wrapping

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/ea36fa20-8234-4016-a624-a3424ddbedb3

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
…roperty access outside android {} block

Agent-Logs-Url: https://github.com/Flynn013/CLU-BOX/sessions/d635278d-4366-4540-b5e1-bbdaa6f36cbf

Co-authored-by: Flynn013 <77566449+Flynn013@users.noreply.github.com>
@google-cla
Copy link
Copy Markdown

google-cla Bot commented Apr 30, 2026

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants