local deepseek instance with ollama

You can get two versions at the moment, a 1gb and a 4gb. The 4gb is smarter but slower, and vice versa.

To install on linux:

ollama run deepseek-r1:1.5b  #1gb model

ollama run hf.co/lmstudio-community/DeepSeek-R1-Distill-Qwen-7B-GGUF:Q3_K_L #4gb model

I haven't given them proper tests yet but here's the 4gb model responding:
note how it puts its computatoin inside <think> </think> before giving the answer. I suppose this is so you can see how it got to the answer. Presumably in deployment cases the end-user doesnt need to see that.

 >>> hello, this is just a test. what is one plus three?
<think>
I start by understanding the question: "What is one plus three?" This 
involves basic addition.
Next, I recognize that adding numbers means combining their values to find 
the total.
So, 1 (which represents a single unit) and another 3 units need to be 
combined.
When I add these together, 1 + 3 equals 4.
Therefore, the final answer is four.
</think>
**Solution:**
We are asked to find the sum of **one** and **three**. 
\[
1 + 3 = \boxed{4}
\]
**Final Answer:**  
\boxed{4}

>>> thanks.
<think>
Alright, thanks for reading my message! I'm happy to help with any 
questions or topics you'd like me to explore further. Just let me know 
what's on your mind, and I'll do my best to assist.
Have a great day!
</think>
**Final Answer:**  
You're welcome! If you have any more questions or need assistance with 
anything, feel free to ask. Have a great day!
>>> 

Popular posts from this blog

Recent Experiments testing ChatGPT's limits and some useful prompts

Introduction ChatGPT has a lot of people excited, but it deserves this level of excitement. It has a number of faults which I list below - some with workarounds - but in general it is amazingly good. It is absolutely not for having fun chatting to a robot, it's really more like a brilliant coworker who is incredibly stupid at some quite mundane tasks, but incredibly good at more tricky tasks. Summary of findings so far.  1. API vs Interactive Version - a caution 2. Coding Strengths and Weaknesses - be very careful but very useful anyway 3. Shell Scripting - amazingly good, probably what it's best at 4. Text Summarisation - fiddly but useful 5. Spreadsheet Analysis - annoying, maybe do by hand 6. Multi-Step Instruction Handling - very annoying 7. Spellchecking and writing style/grammar - ok overall but fiddly 8. File Compatibility and Formatting - not great 9. APA References from DOIs - good 10. Reference Accuracy - bad, double-check its work 11. Tone and Style Adaptations - ex...
Read more

Deepseek

 TLDR: faster than chatgpt but slightly more buggy and the server is apparently overloaded. It didn't quite do as well on the examination/test question marking as ChatGPT, it inferred marks where there were not meant to be any and counted past the limit of 6, giving full marks when I clearly made minor errors that should have cost me 1-2 marks. Transcript follows. Hi. The purpose of this exercise is to test your capabilities. Please write an algorithm in php which counts from 1 to 10 and prints the result to stdout. Certainly! Below is a simple PHP algorithm that counts from 1 to 10 and prints the result to   stdout : php Copy <?php for ( $i = 1 ; $i <= 10 ; $i ++ ) { echo $i . PHP_EOL ; } ?> Explanation: The   for   loop initializes a variable   $i   to 1. The loop continues as long as   $i   is less than or equal to 10. In each iteration, the value of   $i   is printed using   echo . PHP_EOL   is a...
Read more

Update on what ChatGPT is bad at doing.

Image
Intro I've experimented now for about a year with giving ChatGPT tasks. The below criticisms apply to ChatGPT 4o . I recently got access to ChatGPT 4.5 which is better at coding and following instructions (it at least takes the instruction to give steps one at a time, seriously, whereas ChatGPT 4o almost always ignores that). However, 4.5 is more grumpy in tone. I found o1 and o3 not great either, so I keep going back to 4o. Anyway, so far my primary concern is that I can see that within a year or two, this thing will be able to do most of what I can do. It certainly makes my work more efficient. The bad Anyway, this is what 4o is bad at: Making, interpreting, processing, editing spreadsheets. You have to convert the spreadsheet to CSV first (you lose all formulas and charts). It is ok at interpreting small data sets, e.g. 20-30 bits of simple information e.g. amount of money spent per month, with each month listed. It's no good at, for example, creating a Nett Present Value...
Read more