You first have to find out what is wrong with the current installation. Here you can find the dts of the KD20. The interesting part here is the partition table at line 178.
To boot, your NAS needs at least a pre-loader, u-boot and a proper u-boot environment, and a kernel, which are in partition 0, 1, 2 and 4, also called mtd0, mtd1, mtd2 and mtd4. Seeing this table, I’d expect the rootfs (squashfs) to be in mtd3, and the overlay in mtd5. But maybe mtd3 isn’t used at all, and are both squashfs and overlay in mtd5.
You can copy the partitions outside:
dd if=/dev/mtd0 of=/tmp/mtd0
use scp to copy /tmp/mtd0 outside, delete it from /tmp/, and repeat for the other partitions.
Now you can check the partitions outside
file mtd4 should show information about the kernel. strings mtd2 should show the u-boot environment. If the kernelsize shown by mtd4 is smaller than the loaded memory block in the u-boot environment, you know why the box didn’t boot.
mtd0 and mtd1 are harder to check. I’d run strings mtdX and compare that with strings on the pre-loader and u-boot from that dropbox directory, to see if it looks comparable.
/Edit:
Step 3 failed because the install intructions i followed referred to 19.07.5 and now I had downloaded newer files. The result was
No boot from NVRAM
No boot from USB
I think you omitted something from step 3. Just uploading that files to /tmp/ should be harmless. Maybe an out-of-memory crash, but that’s all.
Did boot from USB ever work? AFAIK the SoC doesn’t support that. Maybe u-boot does, with the right environment, but else it was an option of the firmware kernel+initrd. In which case it was not really booting, but executing some script in an early stage.