Alright. The info you guys provided above helped a lot.
I believe it was indeed a problem in the kernel, because this image worked: https://downloads.lede-project.org/releases/17.01-SNAPSHOT/targets/brcm63xx/generic/lede-17.01-snapshot-r3504-1100bbf-brcm63xx-generic-HG655b-squashfs-cfe.bin

Seeing it is a known issue, I don't think I have to send another bug report...
Anyway, I've tried the SMP image too and this works as well.
https://downloads.lede-project.org/releases/17.01-SNAPSHOT/targets/brcm63xx/smp/lede-17.01-snapshot-r3503-f62a31d-brcm63xx-smp-HG655b-squashfs-cfe.bin
This is the bootlog (lede-17.01-snapshot-r3503-f62a31d-brcm63xx-smp-HG655b-squashfs-cfe), if it helps with anything:
CFE version 1.0.37-102.6 for BCM96368 (32bit,SP,BE)
Build Date: Fri Apr 16 15:18:13 CST 2010 (lihua@IBM_x3500)
Copyright (C) 2000-2008 Broadcom Corporation.
Parallel flash device: name AM29LV320MB, id 0x2200, size 8192KB
CPU type 0x2A031: 400MHz, Bus: 160MHz, Ref: 64MHz
CPU running TP0
Total memory: 67108864 bytes (64MB)
Boot Address 0xb8000000
Board IP address : 192.168.1.1:ffffff00
Host IP address : 192.168.1.100
Gateway IP address :
Run from flash/host (f/h) : f
Default host run file name : vmlinux
Default host flash file name : bcm963xx_fs_kernel
Boot delay (0-9 seconds) : 1
Boot image (0=latest, 1=previous) : 0
Board Id (0-6) : HW65x
Number of MAC Addresses (1-32) : 11
Base MAC Address : 02:10:18:01:00:01
PSI Size (1-64) KBytes : 64
Main Thread Number [0|1] : 0
*** Press any key to stop auto run (2 seconds) ***
Auto run second count down: 0
LZMA: Prossible old LZMA format, trying to decompress..
Decompression OK!
Entry at 0x80a00000
Closing network.
Disabling Switch ports.
Flushing Receive Buffers...
0 buffers found.
Closing DMA Channels.
Starting program at 0x80a00000
[ 0.000000] Linux version 4.4.83 (buildbot@builds-02.infra.lede-project.org) (gcc version 5.4.0 (LEDE GCC 5.4.0 r3101-bce140e) ) #0 SMP Mon Aug 21 14:46:18 2017
[ 0.000000] Detected Broadcom 0x6368 CPU revision b2
[ 0.000000] CPU frequency is 400 MHz
[ 0.000000] 64MB of RAM installed
[ 0.000000] board_bcm963xx: Boot address 0xb8000000
[ 0.000000] board_bcm963xx: CFE version: 1.0.37-102.6
[ 0.000000] bootconsole [early0] enabled
[ 0.000000] CPU0 revision is: 0002a031 (Broadcom BMIPS4350)
[ 0.000000] board: board name: HW65x
[ 0.000000] MIPS: machine is Huawei HG655b
[ 0.000000] Determined physical RAM map:
[ 0.000000] memory: 04000000 @ 00000000 (usable)
[ 0.000000] Initrd not found or empty - disabling initrd
[ 0.000000] Zone ranges:
[ 0.000000] Normal [mem 0x0000000000000000-0x0000000003ffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000000000-0x0000000003ffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000000003ffffff]
[ 0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 16 bytes.
[ 0.000000] Primary data cache 32kB, 2-way, VIPT, cache aliases, linesize 16 bytes
[ 0.000000] PERCPU: Embedded 9 pages/cpu @81087000 s8016 r8192 d20656 u36864
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 16256
[ 0.000000] Kernel command line: root=/dev/mtdblock2 rootfstype=squashfs,jffs2 noinitrd console=ttyS0,115200
[ 0.000000] PID hash table entries: 256 (order: -2, 1024 bytes)
[ 0.000000] Dentry cache hash table entries: 8192 (order: 3, 32768 bytes)
[ 0.000000] Inode-cache hash table entries: 4096 (order: 2, 16384 bytes)
[ 0.000000] Memory: 59200K/65536K available (3384K kernel code, 157K rwdata, 516K rodata, 1312K init, 208K bss, 6336K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=16, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] NR_IRQS:256
[ 0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 9556302233 ns
[ 0.000014] sched_clock: 32 bits at 200MHz, resolution 5ns, wraps every 10737418237ns
[ 0.008114] Calibrating delay loop... 397.82 BogoMIPS (lpj=795648)
[ 0.042765] pid_max: default: 32768 minimum: 301
[ 0.047760] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.054538] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.067254] SMP: Booting CPU1...
[ 11.724354] Primary instruction cache 64kB, VIPT, 4-way, linesize 16 bytes.
[ 11.724369] Primary data cache 32kB, 2-way, VIPT, cache aliases, linesize 16 bytes
[ 11.724699] CPU1 revision is: 0002a031 (Broadcom BMIPS4350)
[ 0.119360] Synchronize counters for CPU 1:
[ 0.119362] SMP: CPU1 is running
[ 0.119380] done.
[ 0.119568] Brought up 2 CPUs
[ 0.128782] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.128815] futex hash table entries: 512 (order: 1, 8192 bytes)
[ 0.132747] NET: Registered protocol family 16
[ 0.140768] Can't analyze schedule() prologue at 80017280
[ 0.164351] registering PCI controller with io_map_base unset
[ 0.170306] registering PCI controller with io_map_base unset
[ 0.193136] PCI host bridge to bus 0000:00
[ 0.197388] pci_bus 0000:00: root bus resource [mem 0x30000000-0x37ffffff]
[ 0.204436] pci_bus 0000:00: root bus resource [io 0x8000000-0x8007fff]
[ 0.211331] pci_bus 0000:00: root bus resource [??? 0x00000000 flags 0x0]
[ 0.218318] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[ 0.235007] pci 0000:00:01.0: BAR 0: assigned [mem 0x30000000-0x3000ffff]
[ 0.242705] PCI host bridge to bus 0000:01
[ 0.246916] pci_bus 0000:01: root bus resource [mem 0x38000000-0x3fffffff]
[ 0.253964] pci_bus 0000:01: root bus resource [io 0x8008000-0x800ffff]
[ 0.260877] pci_bus 0000:01: root bus resource [??? 0x00000000 flags 0x0]
[ 0.267850] pci_bus 0000:01: No busn resource found for root bus, will use [bus 01-ff]
[ 0.276428] pci 0000:01:1e.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.285033] pci 0000:01:1e.0: BAR 10: assigned [mem 0x38000000-0x3fffffff]
[ 0.292107] pci 0000:01:1e.0: BAR 7: assigned [io 0x8008000-0x80080ff]
[ 0.298891] pci 0000:01:1e.0: BAR 8: assigned [io 0x8008400-0x80084ff]
[ 0.305699] pci 0000:01:1e.0: CardBus bridge to [bus 02-05]
[ 0.311430] pci 0000:01:1e.0: bridge window [io 0x8008000-0x80080ff]
[ 0.318243] pci 0000:01:1e.0: bridge window [io 0x8008400-0x80084ff]
[ 0.325051] pci 0000:01:1e.0: bridge window [mem 0x38000000-0x3fffffff]
[ 0.334887] clocksource: Switched to clocksource MIPS
[ 0.343181] NET: Registered protocol family 2
[ 0.349155] TCP established hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.356386] TCP bind hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.362955] TCP: Hash tables configured (established 1024 bind 1024)
[ 0.369701] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 0.375793] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 0.382698] NET: Registered protocol family 1
[ 0.389109] Crashlog allocated RAM at address 0x3f00000
[ 0.418273] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 0.424338] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[ 0.440062] io scheduler noop registered
[ 0.444145] io scheduler deadline registered (default)
[ 0.452196] bcm63xx_uart.0: ttyS0 at MMIO 0xb0000100 (irq = 10, base_baud = 1562500) is a bcm63xx_uart
[ 0.461869] console [ttyS0] enabled
[ 0.461869] console [ttyS0] enabled
[ 0.469018] bootconsole [early0] disabled
[ 0.469018] bootconsole [early0] disabled
[ 0.478343] bcm63xx-rng bcm63xx-rng: registered RNG driver
[ 0.485580] 18000000.nor: Found 1 x16 devices at 0x0 in 16-bit bank. Manufacturer ID 0x000001 Chip ID 0x001000
[ 0.496039] Amd/Fujitsu Extended Query Table at 0x0040
[ 0.501316] Amd/Fujitsu Extended Query version 1.3.
[ 0.506490] number of CFI chips: 1
[ 0.510352] bcm63xxpart: CFE boot tag found with version 7 and board type HW65x
[ 0.518026] 7 bcm63xxpart partitions found on MTD device 18000000.nor
[ 0.524671] Creating 7 MTD partitions on "18000000.nor":
[ 0.530112] 0x000000000000-0x000000020000 : "CFE"
[ 0.537620] 0x000000020100-0x00000016ad0c : "kernel"
[ 0.545468] 0x00000016ad0c-0x000000790000 : "rootfs"
[ 0.553119] mtd: device 2 (rootfs) set to be root filesystem
[ 0.559062] 1 squashfs-split partitions found on MTD device rootfs
[ 0.565417] 0x0000003a0000-0x000000790000 : "rootfs_data"
[ 0.573814] 0x000000020000-0x000000790000 : "linux"
[ 0.581390] 0x000000790000-0x0000007c0000 : "board_data"
[ 0.589328] 0x0000007c0000-0x0000007e0000 : "cal_data"
[ 0.597154] 0x0000007e0000-0x000000800000 : "nvram"
[ 0.606550] bcm63xx-spi bcm6358-spi: at [mem 0xb0000800-0xb0000f0b flags 0x200] (irq 9, FIFOs size 542)
[ 0.656181] b53_common: found switch: BCM63xx, rev 0
[ 0.661898] bcm63xx-wdt bcm63xx-wdt: started, timer margin: 30 sec
[ 0.675581] NET: Registered protocol family 10
[ 0.682772] NET: Registered protocol family 17
[ 0.687451] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.
[ 0.700445] 8021q: 802.1Q VLAN Support v1.8
[ 0.713151] VFS: Mounted root (squashfs filesystem) readonly on device 31:2.
[ 0.735377] Freeing unused kernel memory: 1312K
[ 2.032027] init: Console is alive
[ 2.035913] init: - watchdog -
[ 3.166718] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[ 3.288563] usbcore: registered new interface driver usbfs
[ 3.294467] usbcore: registered new interface driver hub
[ 3.300180] usbcore: registered new device driver usb
[ 3.314932] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 3.323324] ehci-platform: EHCI generic platform driver
[ 3.430662] ehci-platform ehci-platform: EHCI Host Controller
[ 3.436625] ehci-platform ehci-platform: new USB bus registered, assigned bus number 1
[ 3.445082] ehci-platform ehci-platform: irq 15, io mem 0xb0001500
[ 3.462633] ehci-platform ehci-platform: USB 2.0 started, EHCI 1.00, overcurrent ignored
[ 3.472503] hub 1-0:1.0: USB hub found
[ 3.476511] hub 1-0:1.0: 2 ports detected
[ 3.486313] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 3.494312] ohci-platform: OHCI generic platform driver
[ 3.499946] ohci-platform ohci-platform: Generic Platform OHCI controller
[ 3.506973] ohci-platform ohci-platform: new USB bus registered, assigned bus number 2
[ 3.515289] ohci-platform ohci-platform: irq 13, io mem 0xb0001600
[ 3.580331] hub 2-0:1.0: USB hub found
[ 3.584332] hub 2-0:1.0: 2 ports detected
[ 3.590031] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[ 3.602370] init: - preinit -
[ 4.458996] random: jshn: uninitialized urandom read (4 bytes read, 62 bits of entropy available)
[ 4.645802] random: jshn: uninitialized urandom read (4 bytes read, 64 bits of entropy available)
[ 4.820150] random: jshn: uninitialized urandom read (4 bytes read, 67 bits of entropy available)
[ 4.894574] random: jshn: uninitialized urandom read (4 bytes read, 68 bits of entropy available)
[ 4.990995] random: jshn: uninitialized urandom read (4 bytes read, 71 bits of entropy available)
[ 5.396735] random: procd: uninitialized urandom read (4 bytes read, 78 bits of entropy available)
Press the [f] key and hit [enter] to enter failsafe mode
Press the [1], [2], [3] or [4] key and hit [enter] to select the debug level
[ 8.842477] jffs2: notice: (399) jffs2_build_xattr_subsystem: complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) and 0 of xref (0 dead, 0 orphan) found.
[ 8.860509] mount_root: switching to jffs2 overlay
[ 8.875107] urandom-seed: Seeding with /etc/urandom.seed
[ 9.065567] procd: - early -
[ 9.068667] procd: - watchdog -
[ 9.741112] procd: - watchdog -
[ 9.744796] procd: - ubus -
[ 9.797286] random: nonblocking pool is initialized
[ 9.957149] procd: - init -
Please press Enter to activate this console.
[ 10.353968] kmodloader: loading kernel modules from /etc/modules.d/*
[ 10.370547] ip6_tables: (C) 2000-2006 Netfilter Core Team
[ 10.394008] Loading modules backported from Linux version wt-2017-01-31-0-ge882dff19e7f
[ 10.402328] Backport generated by backports.git backports-20160324-13-g24da7d3c
[ 10.415151] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 10.434450] nf_conntrack version 0.5.0 (945 buckets, 3780 max)
[ 10.523344] xt_time: kernel timezone is -0000
[ 10.596761] PPP generic driver version 2.4.2
[ 10.603670] NET: Registered protocol family 24
[ 10.639196] PCI: Enabling device 0000:00:01.0 (0000 -> 0002)
[ 10.647848] ieee80211 phy0: rt2x00lib_request_eeprom_file: Info - Loading EEPROM data from 'rt2x00.eeprom'.
[ 10.659071] ieee80211 phy0: rt2x00_set_rt: Info - RT chipset 3572, rev 0223 detected
[ 10.667105] ieee80211 phy0: rt2x00_set_rf: Info - RF chipset 0008 detected
[ 10.681602] kmodloader: done loading kernel modules from /etc/modules.d/*
[ 17.801849] device eth0.1 entered promiscuous mode
[ 17.807003] device eth0 entered promiscuous mode
[ 17.823307] br-lan: port 1(eth0.1) entered forwarding state
[ 17.829368] br-lan: port 1(eth0.1) entered forwarding state
[ 19.830609] br-lan: port 1(eth0.1) entered forwarding state
I'm going to use it daily, if it's stable, until something better appears. And I will inform here as well if I find something wrong with it.
Thanks for all of your help! I really appreciate it.