<h1>[Guide] Backing your content up to HuggingFace via Colab</h1><h2>Today we're going to be looking at an interesting toy I forked from a couple of different people. Please note, that I am not usually a programmer so this is literally just patched content that's been tested!</h2>(The generative pictures included were using models that were uploaded via this tool, and are upcoming updates to Epic Mix and a new mix we're working on!) <h3>AT THE MOMENT I HAVENT PATCHED THIS FOR RUNPOD OR ANY OTHER PLACE BUT I WILL BE TRYING TO DO IT ASAP!</h3>ALSO THIS IS MISSING THE 3.1 SECTION OF THE ORIGINAL CODE AS THAT ONLY WORKS WITH A WEBUI INSTANCE - THIS IS SEPARATED ENTIRELY FROM WEBUI.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/81ea23de-1a86-4f97-9b90-1761c5b706bf/width=525/81ea23de-1a86-4f97-9b90-1761c5b706bf.jpeg" />So you'll see above that's the description i've poorly written in the colab code. Emojis don't always make everything pretty but i'm sort of still finding my way around decorating a colab to make it my own. (Yes feel free to laugh heartily in the comments)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a42996c4-28a6-4594-a352-b4a18b912fff/width=525/a42996c4-28a6-4594-a352-b4a18b912fff.jpeg" />First off before we go INTO THIS make sure you've gotten the updated file if you've copied it. For reference, I am not working off the main file when I do this so I don't share personal information somehow on accident.Also note: This takes 0 resources, no web UI required, and no remote UI's needed apart from the optional file browser included.First of all you'll notice this PROBABLY comes up, please copy it to drive and then YOUR copy you can turn this off so it remembers all your settings from previous times. (This goes for any colab btw)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0d81f590-e1d8-47e1-a05f-2574126ae184/width=525/0d81f590-e1d8-47e1-a05f-2574126ae184.jpeg" />Once you've copied it you'll definitely want to smack the CONNECT button. please note this takes 0 resources like said above apart from internet connection. Google drive is entirely optional on this, and same with the Elfinder plugin.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/89f0dbf8-9fb1-4094-bae9-9df794cd195a/width=525/89f0dbf8-9fb1-4094-bae9-9df794cd195a.jpeg" />THIS IS Of course optional in that you may want to sit and fill everything out first.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/866ee158-2bbc-42d9-9740-1833fbc43703/width=525/866ee158-2bbc-42d9-9740-1833fbc43703.jpeg" />THIS DOES HAVE A MOUNT DRIVE OPTION - and is probably going to be the first thing you do. But hold fire, lemme show you the other things that are enabled in this colab before we get down to where everything is actually useable.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/158e0613-7401-4bcd-bcd2-aa642df38791/width=525/158e0613-7401-4bcd-bcd2-aa642df38791.jpeg" />ImJoy Elfinder, a popular remote UI for the filesystem. This helps you visually see where you're doing things and either way if you do or DONT use google drive options this can help you see and upload new content.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/2eb8be10-a6f2-4c15-9439-94cddb2c4ad6/width=525/2eb8be10-a6f2-4c15-9439-94cddb2c4ad6.jpeg" />Here's the explanations for the HF hub, on Nocrypt's ORIGINAL NOTEBOOK, which i'm happy to pass over because it's one of the best for Colab users.. - He had the 3.1 section which allowed MULTIPLE uploads. If you're ALREADY ON HIS NOTEBOOK this colab is ACTUALLY still useful.Why? Because when I was using his to update some new models i'm working on updating this week - I was able to patch in content to Huggingface to use for batch downloads. Sure, i could've gone in and gotten the Gdrive links, but that's actually kind of a pain when you don't want to make everything a public link.(Literally, I get that some people don't mind but y'all know me I have like 10 repos with 20 model back mixes each and happily share them)This DOES NOT REQUIRE COMPUTE CREDITS ON PRO and Free users CAN use it - be aware that the Elfinder plugin may count as a remote UI.As the colab says:☢☢ How to use this colab ☢☢Scream, because i couldn't get "THE FUN WAY" To work. Which is OK, because the "MANUAL" way is faster. There is no need to actually fix code, or anything just copy and paste your details as instructed.☢☢ MAKE SURE: ☢☢You create a huggingface token, go to <a target="_blank" rel="ugc" href="https://huggingface.co/settings/tokens">this link</a>, then <code>create new token</code> or copy available token with the <code>Write</code> role.🔼 Run cell <code>1,2,3</code>You only need to choose one between <code>3.2,and 3.3</code>Note 3.1 was yoinked because right now I don't know how to patch it to work outside of a stable diffusion instance. If you're using a free colab, try not to use the File Finder - as that's probably considerd a "REMOTE UI"3.2 - Manually upload to HF one at a time (comma'ing the things don't work i've tried it)(3.1 will come back when I learn how to patch it)3.3 - TESTED - It's just a git push via github to Huggingface, and you'll need to make sure you run sections 1 and 2 or it won't be able to do it. It's similar to 3.2 but is evidently more stable. You'll need to run 1 first to log in to your HF account and the details on how this works is here:<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4c15826e-f463-4ba6-9fea-b1e015a758fc/width=525/4c15826e-f463-4ba6-9fea-b1e015a758fc.jpeg" />Note, i had to screenshot BOTH OF THEM together in one window because Civit wasn't letting me upload the separate files. Which is ok cause this is easy enough for you to see. Please note, i'm not here to give a tutorial on how to get an HF account. Two of my tutorials already have this. Just make sure you go to Access tokens on your profile after you've logged in. Yes you can "SEE" some of the information on mine, but you cannot see the actual strings of tokens.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/c095286d-6a6f-40c7-9db6-d61c4b1e6427/width=525/c095286d-6a6f-40c7-9db6-d61c4b1e6427.jpeg" />WHEN YOU GO TO MOUNT it'll ask you if you trust this - that's entirely up to you, this code is in several million notebooks and I didn't make it. SHRUG - Every SD Web Ui notebook using gdrive mount has this.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a002e49c-96b2-40e8-802b-6d97d9f8a4c4/width=525/a002e49c-96b2-40e8-802b-6d97d9f8a4c4.jpeg" />This is what will pop up after you basically go "Yes i trust this please Oauth my ass"Now you've got your token you have the option of MOUNTING your drive. (mine somehow stays mounted I dont get this but y'know i'm brain damaged)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/2d0969d1-5d18-4521-90c1-e2d228c47d0d/width=525/2d0969d1-5d18-4521-90c1-e2d228c47d0d.jpeg" />Optional again is the El-Finder.Why am i sharing the code? because this isn't code I WROTE, you can easily patch these sets of code from Google or Elfinder from their colab samples.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b6f461ee-f409-44ec-b1c0-8d8aa12a9fc3/width=525/b6f461ee-f409-44ec-b1c0-8d8aa12a9fc3.jpeg" />Basically you paste your HF token in section 1, you set up your repo name there. I'll be showing you in the next panel what the CLEAN useable notebook looks like:<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/58eb266a-ae48-4378-94d4-3e8086993bb7/width=525/58eb266a-ae48-4378-94d4-3e8086993bb7.jpeg" />When you see the copy that i've shared with THIS tutorial (because I'm linking AND attaching the colab file in the zip file not just unusable images) you'l note that section 1 is clean, and section 2 has an optional name that in theory you really should replace lol.ours says "RUNPOD BACKUP"Note because of the HF filesystem your things cannot use SPACES you need to break it with underscores like "hf_backup".<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/faec0fda-a46d-4f10-956d-7595a717137b/width=525/faec0fda-a46d-4f10-956d-7595a717137b.jpeg" />Manually you'll be using 3.2 if you don't like me know how 3.3 works _ I realize that i Should but i'm not about to patch my password and username into something that -- Oh screw it i'll do that quick LOL.OK! 3.3 IS WORKINGException: it's just like 3.2, but it's evidently more stable.You're just adding your github email and username and if you haven't done 1-2 you'll get an error that looks like:<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9c3e2c0a-e4d3-4386-839c-f3f819baab68/width=525/9c3e2c0a-e4d3-4386-839c-f3f819baab68.jpeg" />Now once you've uploaded it might look like:(This actually shows you what I last uploaded to HF via this)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/501ffafd-d634-46df-b264-f9efef3acd36/width=525/501ffafd-d634-46df-b264-f9efef3acd36.jpeg" />Again noting that MY thing hasn't patched the good old multi upload via folder, because the code is for a WEB UI based instance. Either you can fork my notebook or you can teach me oh wise ones.NOW! onto the next fun part - what does your repo look like on HF?<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/83217328-bf74-439b-94c6-5a389655bde2/width=525/83217328-bf74-439b-94c6-5a389655bde2.jpeg" />This is your empty repo, I haven't done a repo card on this and it's markdown lingo - I'm not really going to go into how that works but at the end of this i'll link some resources including Nocrypt's notebook and some cool toys to go hand in hand with this.What does it look like with files?<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ac210e38-5675-4c5b-9af9-5507d2abbc9e/width=525/ac210e38-5675-4c5b-9af9-5507d2abbc9e.jpeg" />Ok so you'll note that I KEPT Nocrypt's original line because I took the code from his notebook and credited him so hard that basically the fork of this isn't really mine. If it's uploaded via mine it says "YOINKED B Y EARTH AND DUSK" - you CAN ACTUALLY change this in your notebook settings, it's not required but it's fun. This way i know which notebook i'm using. Lastben notebooks have had for dreambooth a way to upload when done. USUALLY holo's uses gdrive so no need to do it by hand for Loras.RESOURCES:The ACTUAL GITHUB Page for this: <a target="_blank" rel="ugc" href="https://github.com/kieranxsomer/HuggingFace_Backup">https://github.com/kieranxsomer/HuggingFace_Backup</a>Nocrypt's notebook: <a target="_blank" rel="ugc" href="https://colab.research.google.com/drive/1wEa-tS10h4LlDykd87TF5zzpXIIQoCmq">https://colab.research.google.com/drive/1wEa-tS10h4LlDykd87TF5zzpXIIQoCmq</a>Markdown lang tricks for HF cards: <a target="_blank" rel="ugc" href="https://github.com/adam-p/markdown-here/wiki/Markdown-Cheatsheet">https://github.com/adam-p/markdown-here/wiki/Markdown-Cheatsheet</a>Whats included in the zip file: All the pictures, a PDF/docx copy of the tutorial text (and hopefully the images) - as well as a manual download of the most recent copy of the HF backup colab. (That being said you'll want to check Github for the latest updates)☢ You can find updates on NoCrypt's toys: <a target="_blank" rel="ugc" href="https://discord.gg/touhouai">https://discord.gg/touhouai</a>☢ Earth &amp; Dusk Discord because REASONS: <a target="_blank" rel="ugc" href="https://discord.gg/5t2kYxt7An">https://discord.gg/5t2kYxt7An</a>

Files with SHA256: 476e2f154fde962de47f4db2937983232b2930b982b5428afa4aafc30e2bafc7