Page 2 of 2

Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Mon May 01, 2023 9:17 am
by evilsim

with Clonezilla

Interesting idea. I was thinking about trying CloneZilla or Macrium Reflect recently..

Macrium can expand a certain volume to any size based on available space on the destination drive/device, just before actually doing the restore.

It would also be good to use a serial console (if the mister has this? kind of like an enterprise network switch) to show where the boot process gets to, on cards which dont boot after running the migrate_sd.sh script through. Sometimes I can run the script a second time - and it works. This smells like a dying SD card.. The script is flawless it cant really mess up!


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sat May 20, 2023 11:52 am
by MiSSes

I transferred my data from a 400 to a 512gb card. I guess all went well. My mister starts and reacts as it should. Thank you!
Now I'm looking at my files on my new 512 gb card and I see a folder "found.000".
It contains 667 files named "FILE0667.CHK" It contains 4,29gb of data.
What is this folder good for and was this folder on my old card as well?
I do believe that it wasn't before the migration.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sat May 20, 2023 2:41 pm
by jca

It looks like there was some corruption on your SD card. These files contain the data from the corrupted files.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Wed May 31, 2023 7:38 pm
by Fed

Upgraded from a 256 to 512 card, worked great, thanks for this functionality !


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Tue Aug 01, 2023 3:48 pm
by heinzgruber

hi,
i've used migrate_sd.sh and migrate data from a 256 gb card to a 512 gb card. the operation finished successfully.

but now on both sd cards something seems wrong: my daemonbite adapter isn't working anymore. seems like migrate_sd broke Daemonbite support. the adapter get power and my wireless 8bitdo-controller connects but MiSTer doesn't recognize inputs neither in games nor in the menu. When i open up the Definde Joystick Button menu no input is recognized either.

Also the "Switch to USB" menu entry is greyed out. So I guess something with the USB communication is wrong. But my via usb connected bluetooth and snac adapter are still working.

Edit:
Already tried d different USB ports und rund Update_all but the problem is still there.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Tue Aug 01, 2023 6:10 pm
by jca

If you do not have any USB drive connected there is no reason to have "Switch to USB" enabled. As you see USB is working with your Bluetooth. SNAC adapters are not connected via USB but via User GPIO which uses a USB connector but is not USB.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Tue Aug 01, 2023 6:35 pm
by heinzgruber

Okay. Thanks for your Tipps. So my deamonbite problem is very strange. Especially that it is on both sd cards after using the script.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Wed Aug 02, 2023 5:00 am
by heinzgruber

Suddenly my deamonbite adapter is working again so i've no idea whats happened. It never happened before. sorry for the confusion.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Thu Oct 26, 2023 1:10 am
by tomvandeusen

Hi there,

I'm not sure if it's an issue with my MiSTer, but when I try to load your script in the Scripts menu it just flashes some text and goes back to the MiSTer main menu. I assume from other replies that this has some sort of GUI associated with it, and I've never used a script with a GUI. I ran update_all relatively recently but it still is having this issue. Is there something I'm completely missing? My SD Card is fat32 formatted and it's plugged in via USB, but this seems more like an issue of my MiSTer not even reading your script properly.

Thanks so much for your help, and apologies since I don't really run scripts aside from update_all

UPDATE - nevermind, I figured it out. I had it on a CRT and fb_terminal was set to 0 instead of 1 (probably some legacy thing, I've had a MisTer since 2019)


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Thu Oct 26, 2023 6:01 pm
by Longtime4321

I wouldn't reccomend interfacing with scripts over a CRT. Many don't work with one.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Fri Oct 27, 2023 4:26 am
by Fed
Longtime4321 wrote: ↑Thu Oct 26, 2023 6:01 pm

I wouldn't reccomend interfacing with scripts over a CRT. Many don't work with one.

Never had any issues using scripts on a CRT


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sun Dec 10, 2023 4:42 pm
by MEGAMILK

Would it be alright to cancel the script half way through (by rebooting the MiSTer)? I want to rerun it without including the games folder as it’s only going 50Kb/s.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Wed Dec 13, 2023 5:03 pm
by RowanDDX

Worked a treat! Thanks.

Took 1hr25min to copy what was basically a full 32GB card over to a new Sandisk 128GB card. Lots of little files, obviously takes ages.

Only thing that tripped me up initially was that the script failed because I hadn't formatted the microSD card first. Error given was "unable to successfully partition the disk". So I used Windows to format it to whatever the default was (exFat I think), then the script was happy after that. So to be pedantic, to say "no PC required" .. well the PC was required in this case to format the new card. Or maybe there's a MiSTer script to format cards?


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Thu Dec 14, 2023 9:01 am
by lroby74

I've 3 Misters and each one has 32GB microSD with only arcades, ScummVM with games and nothing else.
All my games are on NAS so i can play them from any Mister and are protected with Raid 5 from losing them for faulty HDDs :D


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Thu Dec 14, 2023 9:35 am
by RealLarry
lroby74 wrote: ↑Thu Dec 14, 2023 9:01 am

I've 3 Misters and each one has 32GB microSD with only arcades, ScummVM with games and nothing else.
All my games are on NAS so i can play them from any Mister and are protected with Raid 5 from losing them for faulty HDDs :D

That's it! Same here...but I'm having all cores and its stuff on a NAS. WiFi speed is fast enough to wait just a few seconds.


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sat Dec 23, 2023 1:57 pm
by disq

First time it failed to partition the card (brand new sandisk card, just unpackaged and stuck right in, not sure what kind of partition table was on it) but I insisted (by rebooting) and it's chugging along now. Thanks for the script!


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sat Jan 13, 2024 2:45 pm
by lagerfeldt
Natrox wrote: ↑Sun Oct 30, 2022 12:00 pm

I hope you will find this script useful. Please let me know if you have any questions, problems or nice words.

Works like a charm, thanks! Much easier than doing DD and having to copy block by block of unused data on a 512 GB card.

I'm linking to your script from here: https://misterreplay.com/vault.html

One thing that did surprise me a bit after inserting the newly migrated card for the first time into the MiSTer was that the startup sound and BGM didn't seem to work. Silence.

It appears that the first time a newly migrated card is inserted into the MiSTer and it's powered up it takes a bit of time before something syncs up (20-30 seconds in my case).

Any idea why this is so?


Re: [New version!] SD Card Migration Utility for MiSTer: An easy way to migrate to a new SD card, no PC required

Posted: Sun Mar 24, 2024 11:21 am
by LamerDeluxe

I had an odd bug where the script supposedly finished copying 400GB in one minute. The next time, I opted to do a manual selection of folders to copy and that seems to be working correctly. (got interrupted by MiSTer SAM, which I had turned off before, but sometimes it behaves a bit like a virus).

Tried to clone with AOMEI partition assistent before that. Chose exact clone, which, after five hours, I found out was the wrong decision. You can't resize exFAT partitions. It had placed the recovery(?) partition right between a 400GB sized one and the rest of the almost 600GB unused space. This turned out to be unfixable.

The quick option in AOMEI might have worked correctly (it mentions something about being able to resize a partition). I'm sure it would also take five hours. Though I expect this migration utility to take much longer, judging by the average copying speed. Major advantage being that it should partition correctly. And it's better to leave the MiSTer on than a whole PC, just to copy files.