LongCut logo

Private Obsidian AI: Add DeepSeek to your Obsidian with Ollama (GUIDE + SETUP)

By Tony Huang

Summary

Topics Covered

  • Local AI for Obsidian: Privacy First
  • Obsidian Copilot: Chat, QA, and Relevant Notes
  • Local AI Requires Two Models: LLM and Embedding
  • Maximize Local AI Context Window for Accuracy
  • Private AI for Notes, Public AI for Web

Full Transcript

so if we want to privatize your copilot experience we need actually to install two models now let's change to the QA all right um the same question I will

like to ask now you will have a totally private obsidian compilot in your computer hi friends this is Tony in my last two videos I've demonstrated the incredible

potential of combining of CDM with powerful AI tools you can ask AI to quickly locate what you need from thousands of your past notes you can collaborate with AI to build personalized learning maps and knowledge

graphs tailored to your interests but one important question keeps popping up in the comments is there a local and a private solution I completely understand

this concern after all one of the main reason I choose obsidian over notion is because it offers complete local storage allowing you to keep your nodes 100%

private in this video I will show you exactly how to install your own private local AI cilet directly into obsidian okay this video will be split

into three parts the first part is how to set up obsidian compiler and uh what are those key features the second part is to show you how to install your private AI model deep seek with AMA

lastly you'll be able to integrate your private AI with obsidian copilot to have a true local and private AI in your obsidium okay this is a typical obsidium

interface I have some example notes on the left so uh to install your obsidian compilot you will need to go to the

setting and find your community plugin and search for obsidian copilot this is the co-pilot plugin you will need to download it it was developed by

Logan okay all right after you install it enable your plugin so on the right hand side you find that the API key is not ready

yet if you happen to have an open AI or anthropic API key you can definitely set up here so this is really simple if you

have an open AI API key okay I've already copied my key you need to do is to verify it everything is verified and set up now

you can simply use it on the left hand side you will find your cilet and open that and you can

start chatting say hi there and Tony hello Tony okay the chat mode works and for the vault QA mode uh this is the

mode that you will be able to query your own nerds and uh ask your AI to help you find your nerds okay your copilot already find two cases

and it also showed you the relevant resources AI Implement cases customer agents customer experience support and let's check it

out this is this case was confirmed click therapeutic on clinical use Gemini from Google workspace to

trans to transform complex operation data into actionable Insight good one uh beside ask any questions about

your notes you could also find that if you click the relevant notes let me drop it if you find a note say like um case

report okay the relevant note function showed you the most relevant notes compare with what you write in the drafter note is uh something from is

something from the Enterprise case report uh if you check closely you'll find that this is the part I copied this is also a very important

function I found useful because when you are writing your report or notes or draft the obsidian compilot behind it will actively help you find the most

relevant notes that you may find interesting even though you did not type any links here okay now we find three key obsidian compiler features the first one is chat

mode you can chat with your AI with any topics the second one is Vault QA mode that you can ask your AI to find a relevant notes and ask relevant questions about your notes the third one

is relevant notes when you are reading and writing a notes ciled behind your OB CDM will actively find relevant notes for you

so before we jump into uh how to install your private AI thing I would like to explain a little bit more about how this is possible this will definitely help you understand how can we totally

privatize your AI for your obsidian so behind the Cella actually there are two Motors that is working for you the first one of course is GPT 40 the open air

motor the second one which is also key one is the embedding motor what is embeding embedding is simple it use neuron networks to

translate your neres into numbers those are vector numbers that your machine will be able to calculate the relevance between your thousands of

ndes so when you were creating your new notes the machine behind it will actually use those Vector numbers to calculate similarities between your new notes and your old noes if they find a

similar if they find similar it is high it will pop up if you ask any questions about your notes the machines will calculate and find the most similar and

relevant notes and send it to your AI and answer your question so embedding is the key so if we want to privatize the

copilot experience we need actually to install two models to help you totally privatize it how let's come to the second part

okay let's come to the second part install deep seek AI model with AMA okay what is ama ama is a free software that can help you run large language model in

your computer no matter it is Linux Windows or Mac OS you can simply download and install it then what is dpse currently dsek R1

is the best open source motor you can have on the market right now you can simply download it from llama and have it install to your computer the only one

thing you need to keep in mind is your computer memory if you have a relatively small Ram computer for example 16 GB you

are suggest to install Motors like uh 7B 8B and 14b okay once you have your AMA download what you do is very simple you

copy this sentence here and have it run on on your terminal uh you can directly uh interact with your private model say

how are you today deeps R1 is a sying motor what you will have is a sying process and its final response back to AMA you can also find your ined motor

onama what I recommend is this one currently BGE M3 is also an open source and free motor that even surpass the

performance of O AI of open AI eding motor so BG M3 is here and it is small so it's rly only 1 gig um you copy it

and uh pull your motor here now we have a trap motor ready and embeding motor ready but there's one more thing you need to

do if you are familiar with larger language Motel you know that each motor has its context window um the context window is the amount of tax you can ask

the Moto to help you process for for each Moto download from AMA the default context window is limited by AMA to ensure your Moto's speed since we need

this motor to answer questions about our notes we better to maximize the context window of your local AI otherwise you might find it to be frequently

hallucinating from your notes that's something we don't want to see what you need to do is to copy this command at the terminal here set the

parameter to 128k and the parameter is set then you type

save you can Simply Save the same name as the old Motel all right new model created now

you can check the parameters of your new model show parameters all right your context window is saved as

128k last step link AMA to your obsidian what you need to do is to ensure your AMA is running at the back end and paste the

command and R it what does this mean this means to link your AMA address with obsidian application the application will be able to use AMA model

directly now quick your AMA and type AMA serve your obsidian address is prepared here right let's

quit the terminal now we open AMA again and everything is ready to use okay now we have everything ready

let's integrate your private AI motor with obsidian Copilot I've already removed open thei there's no motor in mycd pallette

what you need to do is to in your motor setting to add your motor here add custom mode uh if you don't remember the exact motor name you should look in your

uh terminal cuz the name should be exactly the same as the AMA motor then pick your provider AMA then verify it

cool everything is ready verification successful since um the murdery is a reasoning motor you can pick it here it's doesn't matter all right uh

remember that we also need an embedding motor you should add your embedding model below here uh don't add here this is chart mode add your embedding model

here at your custom embedding model remember uh you will need to copy the exact the same name of the motor

inama pick AMA and verify it great job let's add the motor once you have your local motor

created you will select it here deep seek R1 and uh yes AMA in Med model everything is ready now let's try

it out okay hi there um how are you view oh cool the thinking motor will think a lot even the simplest

question but the speed is good have any question about sub cidian great job now we can check the vot QA as

well oh before Oh before we use the vote mode uh this's one thing I need to remind you um if we set a new eding motor it will ask you to Reb the index

what you need to do is to click continue now let's change to the QA all right on the same question I will like to

ask great seems like the motor has already find it WS let's search it to see if the motor

is right or not yes we have war war use Gemini to enhance employment confidence in their communication for customer support

effective customer interaction good job now the last function you will find a relevant note here now you will have a totally private obsidian copilot in your

computer and no one can look into your data if you you like my content please hit subscribe and give me a thumbs up now let's wrap it

up so compare with the last two videos um there are two things that currently uh local compil can do which is agentic file management and deep research the

strategy I suggest is that you can have a totally private vot with private Ai and ask questions about your own writings and notes um for information

from the website you are welcome to use those AI providers from open AI Google and the search online um since this is information from public you don't really

need to worry about your privacy for information private you can have a private AI to process with it okay that's it for today if you have any ideas you would like me to try please

leave your comments below and thank you very much and happy hacking bye-bye

Loading...

Loading video analysis...