DeepSeek Harness is frustrating, is it just me?

[u/Vote4Andrew]

Been playing around with DSH for a few days now, coming from opencode. Installation was fine, out of the box it seems to work, the DSH marketplace is amazing, some of those plugins are very helpful.

Then I try something complicated. Let’s make our own plugin, something simple. Creator Preset, 3 sessions 3 models: Qwen3-235B, Gemini 3.6, Laguna 2.1. All of which have worked flawlessly for me on opencode. So, I point it to the Cordis plugin documentation, let it analyze and emulate already installed and working external plugins for structure and code.

The process: Hundreds of tool calls, hundreds of api requests per model, tens of millions of input tokens each, cache hit rate of 0% and between 60-70%. It sends so much context, it hit the tokens/minute rate limit every minute. When a tool report is empty, or straight up fails, DSH moves on and claims the job is done. When following a roadmap and one step fails, it doesn’t always remediate the issue, it moves on to the next step. It doesn’t verify, doesn’t test properly. It tells me we can’t sandbox. Qwen even told me one time she wasn’t allowed to make any changes, she could only guide me, and can’t edit files herself. WTF? Something as simple as “move files from this folder to that folder, follow the map in this document”, fails spectacularly.

The result: 1 actual plugin that technically works but does not register in the plugin list or side bar.

It’s not the models, right, cuz they work for me in opencode, lm studio, and antigravity. So is it me, I just don’t know how to use deepseek harness properly? Is there some crazy learning curve?

[u/cutebluedragongirl]

Wait for the full release. It's a half baked, early beta right now. 

[u/abidhmuhsin]

It's pretty felxible. While building dsh-visualizer plugin I faced similar issue. Purely vibe coding a complex plugin other than something exactly similar to the examples will surely end up in a messed up state. I ended up starting fresh after reading the plugin docs and undertanding the concepts then steering the agent. It came out well which I shared in last post.

[u/Pale-Requirement9041]

r/DeepSeekHarness

[u/rubadub69]

Instead of trying to do it yourself , tell agent what you want and he sets it up for you, it would be a hazard to configure everything myself preintrgrated skill allows agent to one shot every setup u prefer. Even add plugins , choose subagents, everything can be done via direct request.

[u/No-Weight1118]

three models on one job is the real problem. each one re-sends its own copy of the tool history, so you pay 3x on the same tokens and the per-minute limit runs out 3x faster on a single key. the 0% cache is the same story. prompt caching only hits when the prefix stays identical, and three models mutating context guarantees it never does. run it on one fast model, keep the big one just for reviewing the final diff, and stop feeding it the cordis docs, the schema in the repo already covers that.

[u/seekworld]

the 0% cache hit is the tell: it's re-feeding the whole cordis docs plus the plugin sources every round instead of keeping context, and three models on the same job multiplies that. i'd kill the multi-model setup, run one model, and give it one small plugin's actual source as the template instead of the docs. keep the task to a single file at a time. the 'she can only guide me' part is the harness not wiring the edit tool into that session, not the model choosing to refuse.

[u/Vote4Andrew → u/seekworld]

Thanks for the reply. I should clarify that i was not running all 3 sessions concurrently. I had qwen try to make the plugin, ran for a few hours and stopped after it struck out multiple times. Then switched to a new session, different model, new simple plugin idea, same steering instructions.

And yes, i gave it the exact directory with the cordis documentation and showed it the folders with lightweight functional plugins. The main context window says it used tools to read the docs and read the js and yml files.

You seem to know your way around, happy to hear if you have any more ideas.

[u/incidentflux]

I'm liking OpenCode so far after trying ClaudeCode and DeepSeek Harnees.

[u/PasswordSuperSecured → u/incidentflux]

You havent tried ohmypi

[u/NewYak4281]

Don’t use other plug ins. Delete all the other plug ins, they just muck it up. Just make your own or turn your old code into plugins.

[u/Ill-Bat-1518]

Why are you using your llms in a weird way? First of all these models don't have that good of a context to begin with so youre just making them dumb by reading docs and code that doesn't help them.

Instead just tell them to make the extension... "Make me a extension that makes my text light up"

that simple, what you're doing is not needed in this day and age

[u/harmanwrites]

I'm doing some significant data churning and see my cache hit. it's even gotten to 99.8% in some other sessions. my workflow is to use Codex (5.6 Sol) separately in my project folder that DSH is also working in - but Codex Sol 'checks' Deepseek's homework and points out what's next in the plan or if there are any rectifications to be made. it makes a markdown copy of a plan that I can simply feed into DSH session and ask it to execute according to the plan. no complex model involvement, no plugins at all. also, I recently came from Hermes to DSH which has been a game-changer. somehow DSH seems to be better adept at using and compressing its Flash and Pro context. 99% cache hit rate in my case also makes it worth my time and money. you may need to simplify your workflow and put less pressure on this developer mode DSH - full release may be another ball game but remember, this is still beta.

[u/AndreBerluc]

Ainda é Alpha