Docker desktop on mac does not work well (uses lots of resources) and my current alternative is OrbStack (very slick, uses far less resources, but freemium).
I started a company in that market 10 years ago. We compete with palantir. It’s a competitive market with lots of actors.
On of their strengths is the ability of thiel to raise lots of money, and win huge gov contracts by convincing everyone that what he built is magic. it is not.
palantir is regular enterprise software. morally, they are vilains for sure, but their superpower is being excellent at marketing themselves.
What I meant is that they espoused that attitude in the Silicon Valley world, which traditionally has not really invested in Defense. I imagine that's also why they're able to raise lots of money and build hype trains, they have one foot still in SV and SV VC.
It's Redacted.sh, a.k.a. RED. They have around three million torrents. But like What.CD, Redacted.sh is a private tracker, so you can't just jump in and see the content.
It is worth noting that RED is particularly difficult to get a decent ratio on. Spend some time googling reddit posts, there are plenty of examples of people not being able to build solid ratios due to competing with scripted bots.
Another comment mentioned Redacted.sh as a successor. I haven't used it. I'm sure there's a subreddit around that can help. Looks like orpheus is another option if I'm reading correctly. You have to get an invite or pass an "interview" though, so be prepared to wait a while.
TL;DR: we’re the European competitor to Palantir. We build and deploy our data intelligence platform in the World’s biggest organisations (governments, financial institutions, NGOs, industry groups, etc.).
Tech: we are centered on graph visualization with a swappable graph database backend (neo4j, neptune, memgraph, google spanner). Our stack is full typescript (nodejs, angular).
We are looking for someone who can contribute to our nodejs app while also improving our developer experience by contributing code & config to our jenkins/kubernetes/argocd/nexus stack.
Hi, would you be available to share some feedback about the process & tooling? I'm comparing tools for my needs and would love to ask you for details. I can be reached at david [at] linkurio [dot] us
As many people already commented, no one actually visualizes graphs of that size at once.
Context: I’m the CTO of a GraphViz company, I’ve been doing this for 10+ years.
Here are my recommendations:
- if you can generate a projection of your graph into millions of nodes, you might be able to get somewhere with Three.js, which is a JS library to generate WebGL graphics. The library is close enough to the metal to allow you to build something large and fast.
- if you can get the data below 1M nodes, your best shot is Ogma (spoiler: my company made it). It scales well thanks to WebGL and allows for complex interactions. It can run a graph layout on the GPU in your browser. See https://doc.linkurious.com/ogma/latest/examples/layout-force...
- If you want to keep your billions of nodes but are OK with not seeing the whole graph at once, my company builds Linkurious. It is an advanced exploration interface for a graph stored in Neo4j (or Amazon Neptune). We believe that local exploration up to 10k nodes on screen is enough, as long as you can run graph queries and full-text search queries against the whole graph with little friction. See https://doc.linkurious.com/user-manual/latest/running-querie...
Docker desktop on mac does not work well (uses lots of resources) and my current alternative is OrbStack (very slick, uses far less resources, but freemium).