iiinova — where your digital self keeps evolving

SkyGraph @skygraph.art · 12/12/2024

SkyGraph.art It's the graph from June 2024 when there was only 5 million blueskies. Unfortunately, it's not being updated anymore since I can't afford a supercomputer to collect all the data from 20+ mil users

skygraph.art

080

SkyGraph @skygraph.art · 23/10/2024

yes, current load is making it impossible for me to generate datasets on current equipment

120

SkyGraph @skygraph.art · 18/10/2024

I've been somewhat successful in getting official Discover showing me about 80% relevant stuff using "show less"/"show more". 10-20% is still random posts though. the clustering there still doesn't look flexible enough to make everyone happy, but it's much improved. hope that helps 🙏

140

SkyGraph @skygraph.art · 18/10/2024

I'm sure skygaze.io is gone for the same reason. they had the funding, but couldn't figure out business model to justify burning this much of electricity

010

SkyGraph @skygraph.art · 18/10/2024

they're gone, unfortunately our server couldn't handle the load (solvableish) and the size of the dataset (solvable only if you're a startup with good funding, not a pet project)

220

SkyGraph @skygraph.art · 19/09/2024

state at the moment: not enough resources to handle the current load. possible future solutions: 1) getting more funding (not happening, it's a hobby project, not a startup) 2) other team with more resources will pick up the work since everything is open source

100

SkyGraph @skygraph.art · 15/09/2024

SkyGraph is dead until further notice 😭

020

SkyGraph @skygraph.art · 10/09/2024

Good luck pioneers. Keep that Ficsit property safe.

0101

SkyGraph @skygraph.art · 08/09/2024

that's 100% what I'll be up to for the next month or two. so don't ask me 😅

040

SkyGraph @skygraph.art · 08/09/2024

I hate to break the news: Satisfactory 1.0 releases on Tuesday. You have 2 days to wrap it up, folks.

1170

SkyGraph @skygraph.art · 07/09/2024

Why is it so? Well, just a math major gut feeling. later confirmed by my friend who reminded me that even Dijkstra is not streamable, which is an easy graph traversal algorithm compared to Leiden.

0100

SkyGraph @skygraph.art · 07/09/2024

When I realize that in order to make SkyGraph map streamable* I'll need to dig out my math PhD work, spend 5 years in a basement finishing it and then publish a paper explaining why it was impossible. *so that clusters update incrementally in live without needing full dataset recalculation

1163

SkyGraph @skygraph.art · 06/09/2024

Obviously, SATA SSD we've been using has hit it's limit. But if I understand it correctly, IO souldn't be a problem (for now) if using M2 SSDs.

100

SkyGraph @skygraph.art · 06/09/2024

they can't handle the load anymore 😢

110

SkyGraph @skygraph.art · 06/09/2024

Well, this is probably it. But there's hope. All the code is here: github.com/witchmonster... github.com/witchmonster... github.com/witchmonster... Feel free to reach out to @witch.monster if you need any advice on setting it up.

25710

SkyGraph @skygraph.art · 06/09/2024

@suboptimal.technology and @redsolver.dev might be of more help here as @suboptimal.technology is now figuring out how to make the big indexer work (the one for dataset generation), while @redsolver.dev just successfully upgraded infrastructure for his feeds to work with the new firehose throughput

030

SkyGraph @skygraph.art · 06/09/2024

it's kind of both. dataset needed for generating clusters just grew 10x firehose throughput, thus memory+cpu demand for indexers grew 4-5x this is my current setup (that is no longer handling it):

2 SkyGraph @skygraph.art.1d she/her they/them MSI Infinite X (2018 model) gaming PC with Ubuntu installed. Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD www.msi.com/Desktop/infi...

01 SkyGraph @skygraph.art-1d she/her they/them Feeds were running on 8 v. core 16GBram+160GB storage OVH box 2

150

SkyGraph @skygraph.art · 06/09/2024

I think exploring possibilities to continue collaboration with people like @redsolver.dev, who already have some funding and infrastructure to rely on is the most sustainable solution for this project

080

SkyGraph @skygraph.art · 06/09/2024

I appreciate it. I'm willing to donate my work (and a bit of money) into this project. but since I'm not a startup, taking donations is whole another story which is a little bit too much

250

SkyGraph @skygraph.art · 06/09/2024

sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down. I may offer some limited by PDS solution in the future. also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project

3313

SkyGraph @skygraph.art · 05/09/2024

Feeds were running on 8 v. core 16GBram+160GB storage OVH box

020

SkyGraph @skygraph.art · 05/09/2024

MSI Infinite X (2018 model) gaming PC with Ubuntu installed. Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD www.msi.com/Desktop/infi...

120

Reposted by SkyGraph

SkyGraph @skygraph.art · 31/08/2024

This actually might be the end of SkyGraph for foreseeable future. I'll need to check how the big indexer (the one I use for updating the dataset) is doing. Then it's another question whether it would be even possible to construct a dataset this large on current equipment (6 year old PC).

5407

Reposted by SkyGraph

redsolver @redsolver.dev · 01/09/2024

The current SkyFeed infrastructure can't handle the extra load (more than 4x) caused by all the new users. I'm currently setting up two new powerful servers, which should have enough resources to get all feeds back online later today. Thanks for your patience and sorry for the downtime 😊

467122401590

SkyGraph @skygraph.art · 31/08/2024

My Nebula+ and My Galaxy+ might also recover after recent surge depending on what daily load will look like. Currently posts in both are 22 hours behind.

1110

SkyGraph @skygraph.art · 31/08/2024

By the way, these 6 feeds still work since they're powered by @skyfeed.app infrastructure.

2120

Reposted by SkyGraph

redsolver @redsolver.dev · 30/08/2024

All SkyFeed feeds should now be back online, thanks for your patience! This has been the first and only downtime in the last 4 months.

3315125

SkyGraph @skygraph.art · 31/08/2024

Reminder that SkyGraph is fully open-sourced and anyone with desire and the means can continue the good work even if I no longer can. github.com/witchmonster...

github.com

GitHub - witchmonster/core.skygraph.art: Layered community detection

Layered community detection. Contribute to witchmonster/core.skygraph.art development by creating an account on GitHub.

1100

SkyGraph @skygraph.art · 31/08/2024

5407

Reposted by SkyGraph

Atmospheric Cat Hair @witch.monster · 31/08/2024

SkyGraph feed indexer is not doing well. Few hours behind firehose. Same for @bot.skygraph.art If you don't see fresh posts in skygraph feeds - that is why. Hopefully it will catch up once the surge is over.

2194

SkyGraph @skygraph.art · 30/08/2024

!skygraphbot help examples

000

SkyGraph @skygraph.art · 30/08/2024

Also you could use !skygraphbot help and !skygraphbot help examples for more!

010

SkyGraph @skygraph.art · 29/08/2024

!skygraphbot repliesoff mygalaxy+

120

SkyGraph @skygraph.art · 29/08/2024

You can do so with a new post or in (any) replies. For example:

120

SkyGraph @skygraph.art · 29/08/2024

Reminder, you can customize your "My Galaxy+" and "My Nebula+" experience using @bot.skygraph.art 1) turn off/on replies: !skygraphbot repliesoff mygalaxy+ !skygraphbot replieson mynebula+ 2) Remove/add follows mix in? !skygraphbot followsoff mynebula+ !skygraphbot followson mygalaxy+

2121

SkyGraph @skygraph.art · 22/08/2024

Дякуємо за довіру! 🥰

010

SkyGraph @skygraph.art · 23/07/2024

So apparently there was a bug that was rendering the feed empty for the users that tried to use showless. It ended up with the corrupted entry in the db. The bug is now fixed, but the excluded communities for affected users are reset. Sorry for this. 🥺

051

SkyGraph @skygraph.art · 23/07/2024

!skygraphbot showless mygalaxy+::https://bsky.app/profile/pfrazee.com/post/3kxdn7ka2n22y

110

SkyGraph @skygraph.art · 21/07/2024

bsky devs also promised "show less"/"show more" (like you have in discover) feature to custom feeds too, so you won't have to use a bot, which may not be the most user friendly for everyone

010

Reposted by SkyGraph

kickflip @kickflip.renahlee.com · 16/07/2024

hi folks 👋🥹 i’m still actively migrating some things but wanted to give a few usage pointers 👆👈👇👉 you can set up to 🖐️ five 5️⃣ flags but make sure to only send ☝️ one 1️⃣ at a time ⏱️ you can DM @labeler.renahlee.com by going to your messages and hitting the ➕ hope this is helpful 🤲 love, kickflip 🛹🩵

2914215

SkyGraph @skygraph.art · 15/07/2024

Note: "showless" removes entire community from your feed, not a single user/post.

100

SkyGraph @skygraph.art · 15/07/2024

This is reversible with a simple command "undoshowless": !skygraphbot undoshowless mygalaxy+::https://bsky.app/profile/pfrazee.com/post/3kxdn7ka2n22y

120

SkyGraph @skygraph.art · 15/07/2024

Works only with "My Galaxy+" and "My Nebula+" feeds.

000

SkyGraph @skygraph.art · 15/07/2024

To remove irrelevant content from your feed based on a single post/profile use: !skygraphbot showless mygalaxy+::[link to post or profile] !skygraphbot showless mynebula+::[link to post or profile] Example: !skygraphbot showless mygalaxy+::https://bsky.app/profile/pfrazee.com/post/3kxdn7ka2n22y

391

SkyGraph @skygraph.art · 15/07/2024

At least I hope so 😳 I just restarted the indexer and the feeds. They are slurping all of bsky from scratch. I'm sure the timing is pure coincidence.

120