AI assisted coding in NodeRed via Chat

Is it possible to use a LLM chat bot in NodeRED?

Best reply by schwaenen

Hi community,

as part of a mere extra curricular activity, I implemented an assistant for coding in NodeRed via a chatbot dashboard.

The main features of this flow are to:

  • Provide a chatbot-like dashboard directly in NodeRed with some nice UX features
  • Enable piping the output of any NodeRed flow‘s node of interest directly to the LLM prompt (no copy&paste), for example for debugging or analysis
  • Utilize open source LLMs ( Large Language Models (LLMs) @ Bosch) from the API marketplace provided by Bosch Corporate Research (free of charge)
  • Allow switching between different LLMs (depending on availability), even in running conversation, without loosing the context 
  • Offer a customizable system prompt

Please find more information along with some use cases/screencasts in the ppt attached. The source code as .json file can directly be imported in NodeRed and is attached as well in the .zip file.

Since it uses the cURL command for the API, I would expect a straightforward implementation of OpenAIs models, but this is not done. I was hoping for an API to AskBosch, but could not convince Bosch BD that this is not just another chatbot.

Looking forward to your feedback,

Markus

 

coreva_20241005.zip
6.35KB
nodered_ai_assisted_coding.pptx
10.1MB
View original
1
1 reply