GIthub Copilot like Ask/Edit mode + Auto complete

Features
1

Can we include have the below two features? It would increase productivity like

  1. GIthub Copilot like Ask/Edit mode in a chat box -
    • Ask mode - answers question i.e. does RAG on all notes or user selected notes.
      • internet search if possibe
    • Edit mode - makes edits on the selected notes and show preview of edit which user can accept or reject eg: fix the formatiing, expand context, fix grammar
      • internet search if possibe
  2. Auto complete - Auto complete next set of tokens based on text in the note to reduce typing.
  3. Support for local LLMs via LM studio/Ollama etc as second priority hosted LLMs like openai, qwen3 etc

Already used Jarvis with LMstudio but its does not do the above well and is not usable.

GIthub Copilot code was open sourced, would reusing part of that help?

2

Most of these things (not sure if RAG will work) you can probably get working via the VS code Joplin extension.

1 Like
3

I won't implement it again in VSCode extensions since existing tools like GitHub Copilot/Cursor have already done a good enough job. This is also a key reason why I use VSCode instead of Joplin to directly manage my notes - I can directly leverage VSCode's ecosystem rather than having to implement everything myself.

4

This was my point exactly. :slight_smile:

5

Thanks. Just tried the plugin, would it be possible to import/add then display attachments like images/pdfs/audio/video etc using this plugin like joplin does? Currently when i paste it only does this ![alt text](image.png), ![alt text](image-1.png) and so on i.e default vscode way. But this does not render in the Joplin desktop app.

This feature would be a game changer because then we can just use this vscode plugin with power of AI/RAG in vscode.

6

Thanks for your work on Jarvis. Would it be possible to have a chat box in jarvis which make changes in the notebook and we can accept/ reject? Currently jarvis is overwriting the text directly and many times this is not meaning full changes and i cannot reject and give new instructiuons.

7

In the Markdown file's right-click menu, you can see options for uploading images or files.

image
image800×1296 113 KB

Or check VSCode commands to discover more features. I most frequently use Ctrl+J,Ctrl+O for quick search access, which by default displays the twenty most recently edited notes.

image
image1432×952 89.7 KB

1 Like
8

Wow this is cool! For desktop, this setup works well. Thanks for your amazin work. Do you have a roadmap or other features in mind?

Hope in near future, there is a cross platform integrated AI solution which works the same way on andriod app as well an native integration in joplin or joplin plugin. Pixel phone already comes with on device LLMs which can be used by joplin for local AI solution.

9

Currently in maintenance mode. This plugin is mature enough, and if it's still working properly, I won't make any changes to it.

10

There is currently a command Edit selection with Jarvis (on the editor toolbar or menu) that lets you prompt, preview, adjust and accept / reject the result (see screenshot below).

image
image1302×1090 76.2 KB

1 Like
11

I assume Replace is accept and Cancel is reject.

1 Like