[Cerowrt-devel] CeroWrt 3.10.18-1 Field Report

Tue Nov 12 04:11:01 EST 2013

Hi Richard,

On Nov 12, 2013, at 06:47 , Richard E. Brown <richb.hanover at gmail.com> wrote:

> I used the sysupgrade process to upgrade my primary router from 3.7.5-2 firmware to 3.10.18-1.
> 
> - I initially goofed, and installed the wrong build firmware (I installed the WNDR3800 image on a WNDR3700v2 router.) The symptoms were that the router worked, but not very well. Speedtest was gave miserable speeds; netalyzr didn’t work at all. (It said there were serious problems: see http://n3.netalyzr.icsi.berkeley.edu/summary/id=36ea240d-26536-45539c09-7334-456b-b81a ) I was able to download the proper system upgrade firmware, but it took forever. Don’t do it :-)
> 
> - After installing the proper image (for WNDR3700v2), PPPoE didn’t immediately come up on my 7000/768kbps ADSL from Fairpoint. I had to go to the Edit page for the ge00 interface, and click Apply (without making any changes to the saved settings). This caused the link to come right up.
> 
> - The henet 6in4 tunnel did not work. The router received the expected global IPv6 address, and handed an IPv6 global address to my notebook, but neither the router nor the notebook were able to ping ipv6.google.com. I removed that interface from the configs using the GUI.
> 
> - Had to enable and set AQM parameters, since they’re saved differently from the QoS settings in the 3.7.5-2 firmware. Set parameters to ~ 90% of link speeds 

	Just curious, did you specify overhead and encapsulation?

> 
> - The kernel.log shows lots of the stack traces below: 2-5 per second on a long-term basis. 

	These look quite weird, the error is a slow patch warning from hfsc_schedule_watchdog . But, hfsc is the queuing discipline used by stock OpenWrt, cerowrt , so far, has only used HTB (last I checked was cerowrt 3.10.11-3). So my guess is that you were running the default QOS system instead (or worse in addition) to cerowrt's. It would be great to see the output of:
tc -d qdisc ; tc -s class show dev ifb0 ; tc -s class show dev ge00
to check what is up with the AQM system...

Did you by any change use the QOS tab in 3.7.5-2 instead of running AQM or simple_qos.sh from rc.local/ifup? If so did you direct sys upgrade to keep the old configuration files?

> 
> - This may be related to the netalyzr test - after netalyzr completed a run that complained that nothing worked (see above), these errors stopped for a while.
> 
> - However, using NetalyzrCLI.jar, I got the following results where most everything worked: http://n2.netalyzr.icsi.berkeley.edu/summary/id=43ca208a-24217-0cc69e65-e649-4be6-b2c5
> 
> - The PPPoE running on ge00 link seemed to bounce every 10-15 minutes, and I often had to bring it up manually.
> 
> - Reverting to 3.7.5-2.
> 
> 
> [  992.386718] ------------[ cut here ]------------
> [  992.390625] WARNING: at net/sched/sch_hfsc.c:1428 hfsc_dequeue+0x258/0x49c [sch_hfsc]()
> [  992.398437] Modules linked in: ifb ath9k iptable_nat ath9k_common pppoe nf_nat_ipv4 nf_conntrack_ipv4 mac80211 cfg80211 ath9k_hw xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_recent xt_quota xt_policy xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_hashlimit xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connbytes xt_comment xt_addrtype xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY ts_kmp ts_fsm ts_bm pptp pppox ppp_async nf_nat_irc nf_nat_ftp nf_defrag_ipv4 nf_conntrack_irc nf_conntrack_ftp libcrc32c iptable_raw iptable_mangle iptable_filter ipt_ah ipt_REJECT ipt_MASQUERADE ipt_ECN ip_tables crc_ccitt compat ath sch_teql sch_tbf sch_sfq sch_red sch_qfq sch_prio sch_pie sch_ns2_codel sch_nfq_codel sch_netem sch_htb sch_gred sch_efq_codel sch_dsmark sch_codel em_text em_nbyte em_meta em_cmp cls_basic act_police act_ipt act_connmark act_skbedit act_mirred em_u32 cls_u32 cls_tcindex cls_flow cls_route cls_fw sch_hfsc sch_ingress xt_set ip_set_list_set ip_set_hash_netport ip_set_hash_netiface ip_set_hash_net ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6t_NPT ip6t_MASQUERADE ip6table_nat nf_nat_ipv6 nf_nat ip6t_REJECT ip6t_rt ip6t_hbh ip6t_mh ip6t_ipv6header ip6t_frag ip6t_eui64 ip6t_ah ip6table_raw ip6table_mangle ip6table_filter ip6_tables x_tables nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 pppoatm ppp_generic slhc ip_gre gre sit ipcomp xfrm4_tunnel xfrm4_mode_tunnel xfrm4_mode_transport xfrm4_mode_beet esp4 ah4 ip6_tunnel tunnel6 tunnel4 ip_tunnel tun tcp_ledbat af_key xfrm_user xfrm_ipcomp xfrm_algo vfat fat autofs4 br2684 atm nls_utf8 nls_iso8859_2 nls_iso8859_15 nls_iso8859_13 nls_iso8859_1 nls_cp437 ipv6 chainiv eseqiv crypto_wq sha1_generic krng rng md5 hmac des_generic deflate zlib_inflate zlib_deflate cbc authenc aead arc4 crypto_blkcipher usb_storage input_polldev leds_gpio ohci_hcd ledtrig_timer ledtrig_default_on ehci_platform ehci_hcd sd_mod scsi_mod gpio_button_hotplug ext4 crc16 jbd2 mbcache button_hotplug input_core usbcore nls_base usb_common crc32c crypto_hash [last unloaded: ifb]
> [  992.593750] CPU: 0 PID: 1 Comm: procd Tainted: G        W    3.10.18 #1
> [  992.601562] Stack : 00000006 00000000 00000000 00000000 00000000 00000000 803a2abe 0000003b
> [  992.601562] 	  838281a8 802e101c 80382a30 8033173b 00000001 82de5788 803a0000 803a0000
> [  992.601562] 	  00400100 800796c8 00000003 80077080 00000000 00000000 802e28e4 83831d84
> [  992.601562] 	  00831d84 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> [  992.601562] 	  00000000 00000000 00000000 00000000 00000000 00000000 00000000 83831d10
> [  992.601562] 	  ...
> [  992.636718] Call Trace:
> [  992.636718] [<8006e4e4>] show_stack+0x48/0x70
> [  992.644531] [<80077204>] warn_slowpath_common+0x78/0xa8
> [  992.648437] [<8007724c>] warn_slowpath_null+0x18/0x24
> [  992.652343] [<82e41744>] hfsc_dequeue+0x258/0x49c [sch_hfsc]
> [  992.660156] [<80226a48>] __qdisc_run+0xdc/0x18c
> [  992.664062] [<8020bb9c>] net_tx_action+0xdc/0x104
> [  992.667968] [<8007e0fc>] __do_softirq+0xc8/0x1b4
> [  992.671875] [<8007e298>] do_softirq+0x48/0x68
> [  992.675781] [<8007e4d4>] irq_exit+0x54/0x70
> [  992.679687] [<8006082c>] ret_from_irq+0x0/0x4
> [  992.687500] 
> [  992.687500] ---[ end trace 8987bf849bc7e685 ]---
> 
> _______________________________________________
> Cerowrt-devel mailing list
> Cerowrt-devel at lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/cerowrt-devel