[SOLVED] Trace-cmd, missing tracing_on

Hi,

I am seeing some crashes in iwlwifi, wanting to capture more info to debug it. So like outlined here,
https://wireless.wiki.kernel.org/en/users/drivers/iwlwifi/debugging

I'm trying to enable / run trace-cmd. I added it to my build, but when I try to execute it,

root@OpenWrt:/# trace-cmd record -e iwlwifi
trace-cmd: No such file or directory
  opening '/sys/kernel/debug/tracing/tracing_on'

Is this a known issue, or something I need to change to get the tracing working?

Thanks!

Is EVENT_TRACING enabled in the kernel ?

I'll try to enable this for Atheros .

Will check that, thanks! Assuming this is enabled by make kernel_menuconfig?

Seems EVENT_TRACING may no longer be current. Likely this is now all in ftrace. Description of set up is here, including finding that kernel size needs to be < 4 MiB (at least for Xiaomi device):

So you need the full set of CONFIG additions from the link? Just to make sure.

Thanks!

FYI, tried adding those CONFIG entries (from your link), but after building, flashing and rebooting, I still get,

root@OpenWrt:/# trace-cmd record -e iwlwifi
trace-cmd: No such file or directory
  opening '/sys/kernel/debug/tracing/tracing_on'

Thoughts?

Thanks!

now building my own - will keep you updated on progress

—- update ——
first kernel is too big with ftrace configured. Need to trim size. Looking to see what can be cut.

—- update 2 ——
trace-cmd on driver working... Just needed to enable (in .config through make menuconfig)

CONFIG_KERNEL_FTRACE=y
CONFIG_KERNEL_ENABLE_DEFAULT_TRACERS=y
CONFIG_COLLECT_KERNEL_DEBUG=y
CONFIG_PACKAGE_MAC80211_TRACING=y
CONFIG_PACKAGE_IWLWIFI_DEBUG=y
CONFIG_PACKAGE_IWLWIFI_DEBUGFS=y
diffconfig output
CONFIG_TARGET_ath79=y
CONFIG_TARGET_ath79_generic=y
CONFIG_TARGET_ath79_generic_DEVICE_tplink_archer-c7-v2=y
CONFIG_ALL_KMODS=y
CONFIG_ALL_NONSHARED=y
CONFIG_DEVEL=y
CONFIG_AUTOREMOVE=y
CONFIG_BPF_TOOLCHAIN_BUILD_LLVM=y
# CONFIG_BPF_TOOLCHAIN_NONE is not set
CONFIG_BUILDBOT=y
CONFIG_COLLECT_KERNEL_DEBUG=y
# CONFIG_FEED_luci is not set
# CONFIG_FEED_packages is not set
# CONFIG_FEED_routing is not set
# CONFIG_FEED_telephony is not set
CONFIG_HAS_BPF_TOOLCHAIN=y
CONFIG_IB=y
CONFIG_IMAGEOPT=y
CONFIG_KERNEL_BUILD_DOMAIN="buildhost"
CONFIG_KERNEL_BUILD_USER="builder"
CONFIG_KERNEL_ENABLE_DEFAULT_TRACERS=y
CONFIG_KERNEL_FTRACE=y
# CONFIG_KERNEL_KALLSYMS is not set
CONFIG_MAKE_TOOLCHAIN=y
CONFIG_OPENSSL_ENGINE=y
CONFIG_OPENSSL_PREFER_CHACHA_OVER_GCM=y
CONFIG_OPENSSL_WITH_ASM=y
CONFIG_OPENSSL_WITH_CHACHA_POLY1305=y
CONFIG_OPENSSL_WITH_CMS=y
CONFIG_OPENSSL_WITH_DEPRECATED=y
CONFIG_OPENSSL_WITH_ERROR_MESSAGES=y
CONFIG_OPENSSL_WITH_PSK=y
CONFIG_OPENSSL_WITH_SRP=y
CONFIG_OPENSSL_WITH_TLS13=y
CONFIG_PACKAGE_IWLWIFI_DEBUG=y
CONFIG_PACKAGE_IWLWIFI_DEBUGFS=y
CONFIG_PACKAGE_MAC80211_TRACING=y
CONFIG_PACKAGE_adb=m
CONFIG_PACKAGE_adb-enablemodem=m
CONFIG_PACKAGE_ath10k-board-qca9887=m
CONFIG_PACKAGE_ath10k-board-qca9888=m
CONFIG_PACKAGE_ath10k-board-qca9984=m
CONFIG_PACKAGE_ath10k-board-qca99x0=m
CONFIG_PACKAGE_ath10k-firmware-qca9887-ct=m
CONFIG_PACKAGE_ath10k-firmware-qca9887-ct-full-htt=m
CONFIG_PACKAGE_ath10k-firmware-qca9888-ct=m
CONFIG_PACKAGE_ath10k-firmware-qca988x=y
CONFIG_PACKAGE_ath10k-firmware-qca988x-ct=m
CONFIG_PACKAGE_ath10k-firmware-qca9984-ct=m
CONFIG_PACKAGE_ath10k-firmware-qca99x0-ct=m
CONFIG_PACKAGE_cgi-io=y
CONFIG_PACKAGE_fconfig=m
CONFIG_PACKAGE_fritz-tffs=m
CONFIG_PACKAGE_kmod-ath10k=y
CONFIG_PACKAGE_kmod-ath10k-ct=m
CONFIG_PACKAGE_kmod-hwmon-core=m
CONFIG_PACKAGE_kmod-nls-base=m
CONFIG_PACKAGE_kmod-phy-ath79-usb=m
CONFIG_PACKAGE_kmod-rtc-ds1307=m
CONFIG_PACKAGE_kmod-rtc-pcf8563=m
CONFIG_PACKAGE_kmod-usb-core=m
CONFIG_PACKAGE_kmod-usb-ehci=m
CONFIG_PACKAGE_kmod-usb-ledtrig-usbport=m
CONFIG_PACKAGE_kmod-usb2=m
CONFIG_PACKAGE_libbpf=m
CONFIG_PACKAGE_libelf=m
CONFIG_PACKAGE_libiwinfo-lua=y
CONFIG_PACKAGE_liblua=y
CONFIG_PACKAGE_liblucihttp=y
CONFIG_PACKAGE_liblucihttp-lua=y
CONFIG_PACKAGE_libopenssl=m
CONFIG_PACKAGE_libubus-lua=y
CONFIG_PACKAGE_lua=y
CONFIG_PACKAGE_luci=y
CONFIG_PACKAGE_luci-app-firewall=y
CONFIG_PACKAGE_luci-app-opkg=y
CONFIG_PACKAGE_luci-base=y
CONFIG_PACKAGE_luci-lib-base=y
CONFIG_PACKAGE_luci-lib-ip=y
CONFIG_PACKAGE_luci-lib-jsonc=y
CONFIG_PACKAGE_luci-lib-nixio=y
CONFIG_PACKAGE_luci-mod-admin-full=y
CONFIG_PACKAGE_luci-mod-network=y
CONFIG_PACKAGE_luci-mod-status=y
CONFIG_PACKAGE_luci-mod-system=y
CONFIG_PACKAGE_luci-proto-ipv6=y
CONFIG_PACKAGE_luci-proto-ppp=y
CONFIG_PACKAGE_luci-theme-bootstrap=y
CONFIG_PACKAGE_px5g-wolfssl=y
CONFIG_PACKAGE_qosify=m
CONFIG_PACKAGE_rpcd=y
CONFIG_PACKAGE_rpcd-mod-file=y
CONFIG_PACKAGE_rpcd-mod-iwinfo=y
CONFIG_PACKAGE_rpcd-mod-luci=y
CONFIG_PACKAGE_rpcd-mod-rrdns=y
CONFIG_PACKAGE_rssileds=m
CONFIG_PACKAGE_tc-full=m
CONFIG_PACKAGE_tc-mod-iptables=m
CONFIG_PACKAGE_trace-cmd=y
CONFIG_PACKAGE_trace-cmd-extra=y
CONFIG_PACKAGE_uhttpd=y
CONFIG_PACKAGE_uhttpd-mod-ubus=y
CONFIG_PACKAGE_wpad=y
# CONFIG_PACKAGE_wpad-basic-wolfssl is not set
CONFIG_PACKAGE_zlib=m
CONFIG_REPRODUCIBLE_DEBUG_INFO=y
CONFIG_SDK=y
CONFIG_SDK_LLVM_BPF=y
CONFIG_USE_LLVM_BUILD=y
CONFIG_VERSIONOPT=y
CONFIG_VERSION_BUG_URL=""
CONFIG_VERSION_CODE=""
CONFIG_VERSION_DIST="OpenWrt"
CONFIG_VERSION_FILENAMES=y
CONFIG_VERSION_HOME_URL=""
CONFIG_VERSION_HWREV=""
CONFIG_VERSION_MANUFACTURER=""
CONFIG_VERSION_MANUFACTURER_URL=""
CONFIG_VERSION_NUMBER=""
CONFIG_VERSION_PRODUCT=""
CONFIG_VERSION_REPO="https://downloads.openwrt.org/releases/22.03.0"
CONFIG_VERSION_SUPPORT_URL=""
# CONFIG_WPA_WOLFSSL is not set
trace-cmd list on Archer C7 v2

root@OpenWrt:~# trace-cmd list
event systems:
ath10k
mac80211
cfg80211
fib6
bpf_test_run
devlink
skb
net
napi
sock
udp
tcp
fib
qdisc
bridge
page_pool
neigh
thermal
smbus
i2c
rtc
mdio
spi
regmap
regulator
clk
gpio
block
iomap
filelock
io_uring
writeback
migrate
mmap
compaction
kmem
percpu
vmscan
pagemap
oom
filemap
xdp
power
ftrace
cgroup
module
alarmtimer
timer
rcu
printk
sched
workqueue
signal
irq
cpuhp
task
raw_syscalls
initcall

events:
ath10k:ath10k_log_err
ath10k:ath10k_log_warn
ath10k:ath10k_log_info
ath10k:ath10k_log_dbg
ath10k:ath10k_log_dbg_dump
ath10k:ath10k_wmi_cmd
ath10k:ath10k_wmi_event
ath10k:ath10k_htt_stats
ath10k:ath10k_wmi_dbglog
ath10k:ath10k_htt_pktlog
ath10k:ath10k_htt_tx
ath10k:ath10k_txrx_tx_unref
ath10k:ath10k_tx_hdr
ath10k:ath10k_tx_payload
ath10k:ath10k_rx_hdr
ath10k:ath10k_rx_payload
ath10k:ath10k_htt_rx_desc
ath10k:ath10k_wmi_diag_container
ath10k:ath10k_wmi_diag
mac80211:drv_return_void
mac80211:drv_return_int
mac80211:drv_return_bool
mac80211:drv_return_u32
mac80211:drv_return_u64
mac80211:drv_start
mac80211:drv_get_et_strings
mac80211:drv_get_et_sset_count
mac80211:drv_get_et_stats
mac80211:drv_suspend
mac80211:drv_resume
mac80211:drv_set_wakeup
mac80211:drv_stop
mac80211:drv_add_interface
mac80211:drv_change_interface
mac80211:drv_remove_interface
mac80211:drv_config
mac80211:drv_bss_info_changed
mac80211:drv_prepare_multicast
mac80211:drv_configure_filter
mac80211:drv_config_iface_filter
mac80211:drv_set_tim
mac80211:drv_set_key
mac80211:drv_update_tkip_key
mac80211:drv_hw_scan
mac80211:drv_cancel_hw_scan
mac80211:drv_sched_scan_start
mac80211:drv_sched_scan_stop
mac80211:drv_sw_scan_start
mac80211:drv_sw_scan_complete
mac80211:drv_get_stats
mac80211:drv_get_key_seq
mac80211:drv_set_frag_threshold
mac80211:drv_set_rts_threshold
mac80211:drv_set_coverage_class
mac80211:drv_sta_notify
mac80211:drv_sta_state
mac80211:drv_sta_set_txpwr
mac80211:drv_sta_rc_update
mac80211:drv_sta_statistics
mac80211:drv_sta_add
mac80211:drv_sta_remove
mac80211:drv_sta_pre_rcu_remove
mac80211:drv_sync_rx_queues
mac80211:drv_sta_rate_tbl_update
mac80211:drv_conf_tx
mac80211:drv_get_tsf
mac80211:drv_set_tsf
mac80211:drv_offset_tsf
mac80211:drv_reset_tsf
mac80211:drv_tx_last_beacon
mac80211:drv_ampdu_action
mac80211:drv_get_survey
mac80211:drv_flush
mac80211:drv_channel_switch
mac80211:drv_set_antenna
mac80211:drv_get_antenna
mac80211:drv_remain_on_channel
mac80211:drv_cancel_remain_on_channel
mac80211:drv_set_ringparam
mac80211:drv_get_ringparam
mac80211:drv_tx_frames_pending
mac80211:drv_offchannel_tx_cancel_wait
mac80211:drv_set_bitrate_mask
mac80211:drv_set_rekey_data
mac80211:drv_event_callback
mac80211:drv_release_buffered_frames
mac80211:drv_allow_buffered_frames
mac80211:drv_mgd_prepare_tx
mac80211:drv_mgd_complete_tx
mac80211:drv_mgd_protect_tdls_discover
mac80211:drv_add_chanctx
mac80211:drv_remove_chanctx
mac80211:drv_change_chanctx
mac80211:drv_switch_vif_chanctx
mac80211:drv_assign_vif_chanctx
mac80211:drv_unassign_vif_chanctx
mac80211:drv_start_ap
mac80211:drv_stop_ap
mac80211:drv_reconfig_complete
mac80211:drv_ipv6_addr_change
mac80211:drv_join_ibss
mac80211:drv_leave_ibss
mac80211:drv_get_expected_throughput
mac80211:drv_start_nan
mac80211:drv_stop_nan
mac80211:drv_nan_change_conf
mac80211:drv_add_nan_func
mac80211:drv_del_nan_func
mac80211:drv_start_pmsr
mac80211:drv_abort_pmsr
mac80211:api_start_tx_ba_session
mac80211:api_start_tx_ba_cb
mac80211:api_stop_tx_ba_session
mac80211:api_stop_tx_ba_cb
mac80211:api_restart_hw
mac80211:api_beacon_loss
mac80211:api_connection_loss
mac80211:api_disconnect
mac80211:api_cqm_rssi_notify
mac80211:api_cqm_beacon_loss_notify
mac80211:api_scan_completed
mac80211:api_sched_scan_results
mac80211:api_sched_scan_stopped
mac80211:api_sta_block_awake
mac80211:api_chswitch_done
mac80211:api_ready_on_channel
mac80211:api_remain_on_channel_expired
mac80211:api_gtk_rekey_notify
mac80211:api_enable_rssi_reports
mac80211:api_eosp
mac80211:api_send_eosp_nullfunc
mac80211:api_sta_set_buffered
mac80211:wake_queue
mac80211:stop_queue
mac80211:drv_set_default_unicast_key
mac80211:api_radar_detected
mac80211:drv_channel_switch_beacon
mac80211:drv_pre_channel_switch
mac80211:drv_post_channel_switch
mac80211:drv_abort_channel_switch
mac80211:drv_channel_switch_rx_beacon
mac80211:drv_get_txpower
mac80211:drv_tdls_channel_switch
mac80211:drv_tdls_cancel_channel_switch
mac80211:drv_tdls_recv_channel_switch
mac80211:drv_wake_tx_queue
mac80211:drv_get_ftm_responder_stats
mac80211:drv_update_vif_offload
mac80211:drv_sta_set_4addr
mac80211:drv_sta_set_decap_offload
mac80211:drv_add_twt_setup
mac80211:drv_twt_teardown_request
mac80211:drv_net_fill_forward_path
cfg80211:rdev_suspend
cfg80211:rdev_return_int
cfg80211:rdev_scan
cfg80211:rdev_resume
cfg80211:rdev_return_void
cfg80211:rdev_get_antenna
cfg80211:rdev_rfkill_poll
cfg80211:rdev_set_wakeup
cfg80211:rdev_add_virtual_intf
cfg80211:rdev_return_wdev
cfg80211:rdev_del_virtual_intf
cfg80211:rdev_change_virtual_intf
cfg80211:rdev_get_key
cfg80211:rdev_del_key
cfg80211:rdev_add_key
cfg80211:rdev_set_default_key
cfg80211:rdev_set_default_mgmt_key
cfg80211:rdev_set_default_beacon_key
cfg80211:rdev_start_ap
cfg80211:rdev_change_beacon
cfg80211:rdev_stop_ap
cfg80211:rdev_set_rekey_data
cfg80211:rdev_get_mesh_config
cfg80211:rdev_leave_mesh
cfg80211:rdev_leave_ibss
cfg80211:rdev_leave_ocb
cfg80211:rdev_flush_pmksa
cfg80211:rdev_end_cac
cfg80211:rdev_add_station
cfg80211:rdev_change_station
cfg80211:rdev_del_station
cfg80211:rdev_get_station
cfg80211:rdev_del_mpath
cfg80211:rdev_dump_station
cfg80211:rdev_return_int_station_info
cfg80211:rdev_add_mpath
cfg80211:rdev_change_mpath
cfg80211:rdev_get_mpath
cfg80211:rdev_dump_mpath
cfg80211:rdev_get_mpp
cfg80211:rdev_dump_mpp
cfg80211:rdev_return_int_mpath_info
cfg80211:rdev_return_int_mesh_config
cfg80211:rdev_update_mesh_config
cfg80211:rdev_join_mesh
cfg80211:rdev_change_bss
cfg80211:rdev_set_txq_params
cfg80211:rdev_libertas_set_mesh_channel
cfg80211:rdev_set_monitor_channel
cfg80211:rdev_auth
cfg80211:rdev_assoc
cfg80211:rdev_deauth
cfg80211:rdev_disassoc
cfg80211:rdev_mgmt_tx_cancel_wait
cfg80211:rdev_set_power_mgmt
cfg80211:rdev_connect
cfg80211:rdev_update_connect_params
cfg80211:rdev_set_cqm_rssi_config
cfg80211:rdev_set_cqm_rssi_range_config
cfg80211:rdev_set_cqm_txe_config
cfg80211:rdev_disconnect
cfg80211:rdev_join_ibss
cfg80211:rdev_join_ocb
cfg80211:rdev_set_wiphy_params
cfg80211:rdev_get_tx_power
cfg80211:rdev_set_tx_power
cfg80211:rdev_return_int_int
cfg80211:rdev_set_bitrate_mask
cfg80211:rdev_update_mgmt_frame_registrations
cfg80211:rdev_return_int_tx_rx
cfg80211:rdev_return_void_tx_rx
cfg80211:rdev_set_antenna
cfg80211:rdev_sched_scan_start
cfg80211:rdev_sched_scan_stop
cfg80211:rdev_tdls_mgmt
cfg80211:rdev_dump_survey
cfg80211:rdev_return_int_survey_info
cfg80211:rdev_tdls_oper
cfg80211:rdev_probe_client
cfg80211:rdev_set_pmksa
cfg80211:rdev_del_pmksa
cfg80211:rdev_remain_on_channel
cfg80211:rdev_return_int_cookie
cfg80211:rdev_cancel_remain_on_channel
cfg80211:rdev_mgmt_tx
cfg80211:rdev_tx_control_port
cfg80211:rdev_set_noack_map
cfg80211:rdev_get_channel
cfg80211:rdev_return_chandef
cfg80211:rdev_start_p2p_device
cfg80211:rdev_stop_p2p_device
cfg80211:rdev_start_nan
cfg80211:rdev_nan_change_conf
cfg80211:rdev_stop_nan
cfg80211:rdev_add_nan_func
cfg80211:rdev_del_nan_func
cfg80211:rdev_set_mac_acl
cfg80211:rdev_update_ft_ies
cfg80211:rdev_crit_proto_start
cfg80211:rdev_crit_proto_stop
cfg80211:rdev_channel_switch
cfg80211:rdev_set_qos_map
cfg80211:rdev_set_ap_chanwidth
cfg80211:rdev_add_tx_ts
cfg80211:rdev_del_tx_ts
cfg80211:rdev_tdls_channel_switch
cfg80211:rdev_tdls_cancel_channel_switch
cfg80211:rdev_set_pmk
cfg80211:rdev_del_pmk
cfg80211:rdev_external_auth
cfg80211:rdev_start_radar_detection
cfg80211:rdev_set_mcast_rate
cfg80211:rdev_set_coalesce
cfg80211:rdev_abort_scan
cfg80211:rdev_set_multicast_to_unicast
cfg80211:rdev_get_txq_stats
cfg80211:rdev_get_ftm_responder_stats
cfg80211:rdev_start_pmsr
cfg80211:rdev_abort_pmsr
cfg80211:cfg80211_return_bool
cfg80211:cfg80211_notify_new_peer_candidate
cfg80211:cfg80211_send_rx_auth
cfg80211:cfg80211_send_rx_assoc
cfg80211:cfg80211_rx_unprot_mlme_mgmt
cfg80211:cfg80211_rx_mlme_mgmt
cfg80211:cfg80211_tx_mlme_mgmt
cfg80211:cfg80211_send_auth_timeout
cfg80211:cfg80211_send_assoc_timeout
cfg80211:cfg80211_michael_mic_failure
cfg80211:cfg80211_ready_on_channel
cfg80211:cfg80211_ready_on_channel_expired
cfg80211:cfg80211_tx_mgmt_expired
cfg80211:cfg80211_new_sta
cfg80211:cfg80211_del_sta
cfg80211:cfg80211_rx_mgmt
cfg80211:cfg80211_mgmt_tx_status
cfg80211:cfg80211_control_port_tx_status
cfg80211:cfg80211_rx_control_port
cfg80211:cfg80211_cqm_rssi_notify
cfg80211:cfg80211_reg_can_beacon
cfg80211:cfg80211_chandef_dfs_required
cfg80211:cfg80211_ch_switch_notify
cfg80211:cfg80211_ch_switch_started_notify
cfg80211:cfg80211_radar_event
cfg80211:cfg80211_cac_event
cfg80211:cfg80211_rx_spurious_frame
cfg80211:cfg80211_rx_unexpected_4addr_frame
cfg80211:cfg80211_ibss_joined
cfg80211:cfg80211_probe_status
cfg80211:cfg80211_cqm_pktloss_notify
cfg80211:cfg80211_gtk_rekey_notify
cfg80211:cfg80211_pmksa_candidate_notify
cfg80211:cfg80211_report_obss_beacon
cfg80211:cfg80211_tdls_oper_request
cfg80211:cfg80211_scan_done
cfg80211:cfg80211_sched_scan_stopped
cfg80211:cfg80211_sched_scan_results
cfg80211:cfg80211_get_bss
cfg80211:cfg80211_inform_bss_frame
cfg80211:cfg80211_return_bss
cfg80211:cfg80211_return_uint
cfg80211:cfg80211_return_u32
cfg80211:cfg80211_report_wowlan_wakeup
cfg80211:cfg80211_ft_event
cfg80211:cfg80211_stop_iface
cfg80211:cfg80211_pmsr_report
cfg80211:cfg80211_pmsr_complete
cfg80211:rdev_update_owe_info
cfg80211:cfg80211_update_owe_info_event
cfg80211:rdev_probe_mesh_link
cfg80211:rdev_set_tid_config
cfg80211:rdev_reset_tid_config
cfg80211:rdev_set_sar_specs
cfg80211:rdev_color_change
cfg80211:cfg80211_bss_color_notify
cfg80211:rdev_set_radar_background
initcall:initcall_finish
initcall:initcall_start
initcall:initcall_level
raw_syscalls:sys_exit
raw_syscalls:sys_enter
task:task_rename
task:task_newtask
cpuhp:cpuhp_exit
cpuhp:cpuhp_multi_enter
cpuhp:cpuhp_enter
irq:softirq_raise
irq:softirq_exit
irq:softirq_entry
irq:irq_handler_exit
irq:irq_handler_entry
signal:signal_deliver
signal:signal_generate
workqueue:workqueue_execute_end
workqueue:workqueue_execute_start
workqueue:workqueue_activate_work
workqueue:workqueue_queue_work
sched:sched_wake_idle_without_ipi
sched:sched_swap_numa
sched:sched_stick_numa
sched:sched_move_numa
sched:sched_pi_setprio
sched:sched_stat_runtime
sched:sched_process_exec
sched:sched_process_fork
sched:sched_process_wait
sched:sched_wait_task
sched:sched_process_exit
sched:sched_process_free
sched:sched_migrate_task
sched:sched_switch
sched:sched_wakeup_new
sched:sched_wakeup
sched:sched_waking
sched:sched_kthread_stop_ret
sched:sched_kthread_stop
printk:console
rcu:rcu_utilization
timer:itimer_expire
timer:itimer_state
timer:hrtimer_cancel
timer:hrtimer_expire_exit
timer:hrtimer_expire_entry
timer:hrtimer_start
timer:hrtimer_init
timer:timer_cancel
timer:timer_expire_exit
timer:timer_expire_entry
timer:timer_start
timer:timer_init
alarmtimer:alarmtimer_cancel
alarmtimer:alarmtimer_start
alarmtimer:alarmtimer_fired
alarmtimer:alarmtimer_suspend
module:module_request
module:module_put
module:module_get
module:module_free
module:module_load
cgroup:cgroup_notify_frozen
cgroup:cgroup_notify_populated
cgroup:cgroup_transfer_tasks
cgroup:cgroup_attach_task
cgroup:cgroup_unfreeze
cgroup:cgroup_freeze
cgroup:cgroup_rename
cgroup:cgroup_release
cgroup:cgroup_rmdir
cgroup:cgroup_mkdir
cgroup:cgroup_remount
cgroup:cgroup_destroy_root
cgroup:cgroup_setup_root
power:dev_pm_qos_remove_request
power:dev_pm_qos_update_request
power:dev_pm_qos_add_request
power:pm_qos_update_flags
power:pm_qos_update_target
power:pm_qos_remove_request
power:pm_qos_update_request
power:pm_qos_add_request
power:power_domain_target
power:clock_set_rate
power:clock_disable
power:clock_enable
power:wakeup_source_deactivate
power:wakeup_source_activate
power:suspend_resume
power:device_pm_callback_end
power:device_pm_callback_start
power:cpu_frequency_limits
power:cpu_frequency
power:pstate_sample
power:powernv_throttle
power:cpu_idle
xdp:mem_return_failed
xdp:mem_connect
xdp:mem_disconnect
xdp:xdp_devmap_xmit
xdp:xdp_cpumap_enqueue
xdp:xdp_cpumap_kthread
xdp:xdp_redirect_map_err
xdp:xdp_redirect_map
xdp:xdp_redirect_err
xdp:xdp_redirect
xdp:xdp_bulk_tx
xdp:xdp_exception
filemap:file_check_and_advance_wb_err
filemap:filemap_set_wb_err
filemap:mm_filemap_add_to_page_cache
filemap:mm_filemap_delete_from_page_cache
oom:compact_retry
oom:skip_task_reaping
oom:finish_task_reaping
oom:start_task_reaping
oom:wake_reaper
oom:mark_victim
oom:reclaim_retry_zone
oom:oom_score_adj_update
pagemap:mm_lru_activate
pagemap:mm_lru_insertion
vmscan:mm_vmscan_node_reclaim_end
vmscan:mm_vmscan_node_reclaim_begin
vmscan:mm_vmscan_inactive_list_is_low
vmscan:mm_vmscan_lru_shrink_active
vmscan:mm_vmscan_lru_shrink_inactive
vmscan:mm_vmscan_writepage
vmscan:mm_vmscan_lru_isolate
vmscan:mm_shrink_slab_end
vmscan:mm_shrink_slab_start
vmscan:mm_vmscan_memcg_softlimit_reclaim_end
vmscan:mm_vmscan_memcg_reclaim_end
vmscan:mm_vmscan_direct_reclaim_end
vmscan:mm_vmscan_memcg_softlimit_reclaim_begin
vmscan:mm_vmscan_memcg_reclaim_begin
vmscan:mm_vmscan_direct_reclaim_begin
vmscan:mm_vmscan_wakeup_kswapd
vmscan:mm_vmscan_kswapd_wake
vmscan:mm_vmscan_kswapd_sleep
percpu:percpu_destroy_chunk
percpu:percpu_create_chunk
percpu:percpu_alloc_percpu_fail
percpu:percpu_free_percpu
percpu:percpu_alloc_percpu
kmem:rss_stat
kmem:mm_page_alloc_extfrag
kmem:mm_page_pcpu_drain
kmem:mm_page_alloc_zone_locked
kmem:mm_page_alloc
kmem:mm_page_free_batched
kmem:mm_page_free
kmem:kmem_cache_free
kmem:kfree
kmem:kmem_cache_alloc_node
kmem:kmalloc_node
kmem:kmem_cache_alloc
kmem:kmalloc
compaction:mm_compaction_kcompactd_wake
compaction:mm_compaction_wakeup_kcompactd
compaction:mm_compaction_kcompactd_sleep
compaction:mm_compaction_defer_reset
compaction:mm_compaction_defer_compaction
compaction:mm_compaction_deferred
compaction:mm_compaction_suitable
compaction:mm_compaction_finished
compaction:mm_compaction_try_to_compact_pages
compaction:mm_compaction_end
compaction:mm_compaction_begin
compaction:mm_compaction_migratepages
compaction:mm_compaction_isolate_freepages
compaction:mm_compaction_isolate_migratepages
mmap:vm_unmapped_area
migrate:mm_migrate_pages
writeback:sb_clear_inode_writeback
writeback:sb_mark_inode_writeback
writeback:writeback_dirty_inode_enqueue
writeback:writeback_lazytime_iput
writeback:writeback_lazytime
writeback:writeback_single_inode
writeback:writeback_single_inode_start
writeback:writeback_wait_iff_congested
writeback:writeback_congestion_wait
writeback:writeback_sb_inodes_requeue
writeback:balance_dirty_pages
writeback:bdi_dirty_ratelimit
writeback:global_dirty_state
writeback:writeback_queue_io
writeback:wbc_writepage
writeback:writeback_bdi_register
writeback:writeback_wake_background
writeback:writeback_pages_written
writeback:writeback_wait
writeback:writeback_written
writeback:writeback_start
writeback:writeback_exec
writeback:writeback_queue
writeback:writeback_write_inode
writeback:writeback_write_inode_start
writeback:flush_foreign
writeback:track_foreign_dirty
writeback:inode_switch_wbs
writeback:inode_foreign_history
writeback:writeback_dirty_inode
writeback:writeback_dirty_inode_start
writeback:writeback_mark_inode_dirty
writeback:wait_on_page_writeback
writeback:writeback_dirty_page
io_uring:io_uring_task_run
io_uring:io_uring_task_add
io_uring:io_uring_poll_wake
io_uring:io_uring_poll_arm
io_uring:io_uring_submit_sqe
io_uring:io_uring_complete
io_uring:io_uring_fail_link
io_uring:io_uring_cqring_wait
io_uring:io_uring_link
io_uring:io_uring_defer
io_uring:io_uring_queue_async_work
io_uring:io_uring_file_get
io_uring:io_uring_register
io_uring:io_uring_create
filelock:leases_conflict
filelock:generic_add_lease
filelock:time_out_leases
filelock:generic_delete_lease
filelock:break_lease_unblock
filelock:break_lease_block
filelock:break_lease_noblock
filelock:flock_lock_inode
filelock:locks_remove_posix
filelock:fcntl_setlk
filelock:posix_lock_inode
filelock:locks_get_lock_context
iomap:iomap_apply
iomap:iomap_apply_srcmap
iomap:iomap_apply_dstmap
iomap:iomap_dio_invalidate_fail
iomap:iomap_invalidatepage
iomap:iomap_releasepage
iomap:iomap_writepage
iomap:iomap_readahead
iomap:iomap_readpage
block:block_rq_remap
block:block_bio_remap
block:block_split
block:block_unplug
block:block_plug
block:block_sleeprq
block:block_getrq
block:block_bio_queue
block:block_bio_frontmerge
block:block_bio_backmerge
block:block_bio_complete
block:block_bio_bounce
block:block_rq_merge
block:block_rq_issue
block:block_rq_insert
block:block_rq_complete
block:block_rq_requeue
block:block_dirty_buffer
block:block_touch_buffer
gpio:gpio_value
gpio:gpio_direction
clk:clk_set_duty_cycle_complete
clk:clk_set_duty_cycle
clk:clk_set_phase_complete
clk:clk_set_phase
clk:clk_set_parent_complete
clk:clk_set_parent
clk:clk_set_rate_complete
clk:clk_set_rate
clk:clk_unprepare_complete
clk:clk_unprepare
clk:clk_prepare_complete
clk:clk_prepare
clk:clk_disable_complete
clk:clk_disable
clk:clk_enable_complete
clk:clk_enable
regulator:regulator_set_voltage_complete
regulator:regulator_set_voltage
regulator:regulator_bypass_disable_complete
regulator:regulator_bypass_disable
regulator:regulator_bypass_enable_complete
regulator:regulator_bypass_enable
regulator:regulator_disable_complete
regulator:regulator_disable
regulator:regulator_enable_complete
regulator:regulator_enable_delay
regulator:regulator_enable
regmap:regcache_drop_region
regmap:regmap_async_complete_done
regmap:regmap_async_complete_start
regmap:regmap_async_io_complete
regmap:regmap_async_write_start
regmap:regmap_cache_bypass
regmap:regmap_cache_only
regmap:regcache_sync
regmap:regmap_hw_write_done
regmap:regmap_hw_write_start
regmap:regmap_hw_read_done
regmap:regmap_hw_read_start
regmap:regmap_reg_read_cache
regmap:regmap_reg_read
regmap:regmap_reg_write
spi:spi_transfer_stop
spi:spi_transfer_start
spi:spi_message_done
spi:spi_message_start
spi:spi_message_submit
spi:spi_controller_busy
spi:spi_controller_idle
mdio:mdio_access
rtc:rtc_timer_fired
rtc:rtc_timer_dequeue
rtc:rtc_timer_enqueue
rtc:rtc_read_offset
rtc:rtc_set_offset
rtc:rtc_alarm_irq_enable
rtc:rtc_irq_set_state
rtc:rtc_irq_set_freq
rtc:rtc_read_alarm
rtc:rtc_set_alarm
rtc:rtc_read_time
rtc:rtc_set_time
i2c:i2c_result
i2c:i2c_reply
i2c:i2c_read
i2c:i2c_write
smbus:smbus_result
smbus:smbus_reply
smbus:smbus_read
smbus:smbus_write
thermal:thermal_power_cpu_limit
thermal:thermal_power_cpu_get_power
thermal:thermal_zone_trip
thermal:cdev_update
thermal:thermal_temperature
neigh:neigh_cleanup_and_release
neigh:neigh_event_send_dead
neigh:neigh_event_send_done
neigh:neigh_timer_handler
neigh:neigh_update_done
neigh:neigh_update
neigh:neigh_create
page_pool:page_pool_update_nid
page_pool:page_pool_state_hold
page_pool:page_pool_state_release
page_pool:page_pool_release
bridge:br_fdb_update
bridge:fdb_delete
bridge:br_fdb_external_learn_add
bridge:br_fdb_add
qdisc:qdisc_create
qdisc:qdisc_destroy
qdisc:qdisc_reset
qdisc:qdisc_dequeue
fib:fib_table_lookup
tcp:tcp_probe
tcp:tcp_retransmit_synack
tcp:tcp_rcv_space_adjust
tcp:tcp_destroy_sock
tcp:tcp_receive_reset
tcp:tcp_send_reset
tcp:tcp_retransmit_skb
udp:udp_fail_queue_rcv_skb
sock:inet_sock_set_state
sock:sock_exceed_buf_limit
sock:sock_rcvqueue_full
napi:napi_poll
net:netif_receive_skb_list_exit
net:netif_rx_ni_exit
net:netif_rx_exit
net:netif_receive_skb_exit
net:napi_gro_receive_exit
net:napi_gro_frags_exit
net:netif_rx_ni_entry
net:netif_rx_entry
net:netif_receive_skb_list_entry
net:netif_receive_skb_entry
net:napi_gro_receive_entry
net:napi_gro_frags_entry
net:netif_rx
net:netif_receive_skb
net:net_dev_queue
net:net_dev_xmit_timeout
net:net_dev_xmit
net:net_dev_start_xmit
skb:skb_copy_datagram_iovec
skb:consume_skb
skb:kfree_skb
devlink:devlink_trap_report
devlink:devlink_health_reporter_state_update
devlink:devlink_health_recover_aborted
devlink:devlink_health_report
devlink:devlink_hwerr
devlink:devlink_hwmsg
bpf_test_run:bpf_test_finish
fib6:fib6_table_lookup

tracers:
nop

options:
print-parent
nosym-offset
nosym-addr
noverbose
noraw
nohex
nobin
noblock
trace_printk
annotate
nouserstacktrace
nosym-userobj
noprintk-msg-only
context-info
nolatency-format
record-cmd
norecord-tgid
overwrite
nodisable_on_free
irq-info
markers
noevent-fork
nopause-on-trace
nostacktrace
notest_nop_accept
notest_nop_refuse

EVENT_TRACING is enabled by default in my kernel config. Note that I just added the IWLWIFI for reference (my target doesn't use it).

1 Like

Sounds great, thanks! Could just be me :rofl:

Dang it - missed your edits, sorry. No email sent for edits :frowning_face:.

That works - thanks! Seems just that set of entries needed ... agreed? I just added them to .config, and then make menuconfig => build and go :smile:.

I just need to figure out how to start the trace on boot, run in the background. Thanks again!

That’s right. There are dependencies, and these should be taken care of during compilation. make menuconfig makes it however very easy to see the individual symbol relation.

Regarding boot, perhaps simplest to leave the wifi down and kernel modules unloaded until you’ve run trace-cmd?

Looks like I can just run it in the background (standard &). No clean exit, except kill :laughing:

Thanks!

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.