`render_session_summary` in HITL mode

[Robbybp]

It would be nice to have an option to report timing information for each URSA command when running in HITL mode. My initial naive attempt at this was to add, e.g., render_session_summary(self.executor.thread_id) at the end of each run_* method in HITL, but this just gave the "No session data" message.

[luiarthur]

@Robbybp sorry for the delay. One way to do this is to implement the following in ursa/cli/hitl.py

• do_metrics in UrsaRepl(Cmd)

  class UrsaRepl:
      def do_metrics(self, agent: str=""):
          self.hitl.render_metrics(agent)

• render_metrics_for_last_agent in HITL

  class HITL:
      def __post_init__(self): 
         self._last_agent = ""  # tracks which agent was last called
      
      @property
      def _last_agent_thread_id(self):
          """Return the thread id of the most recently called agent."""
          if self._last_agent == "":
              raise ValueError("No agents have been called yet.")
  
          return f"{self.thread_id}_{self._last_agent}"
  
      # TODO:
      # In each of the `run_*` methods (e.g. `run_arxiv`, `run_executor`, etc.),
      # update `self.last_agent` to the name of the agent before returning.
      # e.g., `self.last_agent = executor` near the end of `run_executor`
  
      def render_metrics(self, agent: Optional[str] = None) -> None:
          thread_id = self.last_agent_thread_id if agent is None else f"{self.thread_id}_{agent}"
          render_session_summary(thread_id)
          

so that when user types metrics <agent> (e.g. metrics executor) metrics for the executor agent for will be shown.

A few notes:

• metrics are now enabled by default
• in the example above, if metrics (with no agent) only is provided, then the last agent's summary is rendered. If metrics is followed by an agent name (e.g. metrics executor) then metrics for executor for the entire lifetime of the thread is rendered.
• I could have botched something above...

Do you want to try implementing and submitting a PR for this?