Opened 13 years ago

Closed 13 years ago

#1292 closed defect (invalid)

Oscam Randomly crashed

Reported by: Bkmz Owned by:
Priority: critical Component: General
Severity: medium Keywords: kernel, crash, general protection
Cc: Sensitive: no

Description

Revision

3942

Issue Description

Oscam randomly crashed on xen guest.

When the issue occurs

randomly

How the issue is reproducable

haven't got any information

[   11.033462] EXT3 FS on hda, internal journal
[27939.898153]  =======================
[27941.989100] INFO: task oscam:11713 blocked for more than 120 seconds.
[27941.990388] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27941.990716] oscam         D c884ab4c     0 11713      1
[27941.990716]        cf4a05a0 00000282 c148f9a0 c884ab4c c0106227 cf4a0728 c1231b40 00000000 
[27941.990716]        ce7a1c80 7f2b34d0 0068f394 7f2a8d38 0009fbf3 c884ab4c 0025c366 c148f9a0 
[27941.991841]        c884ab4c c01331f4 0025c366 c884ab4c 0025c366 c148f9a0 c1231b40 00e72000 
[27941.992970] Call Trace:
[27941.995154]  [<c0106227>] xen_clocksource_read+0xc/0x164
[27941.996445]  [<c01331f4>] getnstimeofday+0x37/0xbc
[27941.997585]  [<c018e13a>] sync_buffer+0x0/0x33
[27941.998698]  [<c02ca66c>] io_schedule+0x49/0x80
[27941.999791]  [<c018e16a>] sync_buffer+0x30/0x33
[27942.000851]  [<c02ca798>] __wait_on_bit_lock+0x2a/0x52
[27942.063231]  [<c018e13a>] sync_buffer+0x0/0x33
[27942.064290]  [<c02ca81f>] out_of_line_wait_on_bit_lock+0x5f/0x67
[27942.065329]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[27942.065389]  [<c018e327>] __lock_buffer+0x21/0x24
[27942.066385]  [<d1242536>] do_get_write_access+0x4c/0x367 [jbd]
[27942.067402]  [<c018d96d>] __find_get_block+0x198/0x1a2
[27942.068419]  [<d1242fc1>] journal_get_undo_access+0x25/0xf0 [jbd]
[27942.069461]  [<d1281619>] __ext3_journal_get_undo_access+0x13/0x32 [ext3]
[27942.070539]  [<d1273b53>] ext3_try_to_allocate_with_rsv+0x3c/0x443 [ext3]
[27942.071627]  [<d1276832>] ext3_mark_inode_dirty+0x20/0x27 [ext3]
[27942.072644]  [<d1274131>] ext3_new_blocks+0x1d7/0x5b5 [ext3]
[27942.076648]  [<c017b7ce>] do_select+0x3a0/0x3bd
[27942.077001]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[27942.077001]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[27942.077001]  [<c018e755>] __block_prepare_write+0x164/0x366
[27942.078081]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[27942.079143]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[27942.080218]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[27942.081290]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[27942.082349]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[27942.083418]  [<d12424e1>] journal_stop+0x1a4/0x1ad [jbd]
[27942.084500]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[27942.088562]  [<c017ebcb>] dput+0x16/0x109
[27942.088873]  [<c0184aa9>] mnt_drop_write+0x1b/0xe4
[27942.088873]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[27942.088873]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[27942.089921]  [<c016fd27>] do_sync_write+0xbf/0x100
[27942.090936]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[27942.271495]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[27942.272530]  [<c01732bc>] sys_stat64+0x1e/0x23
[27942.273501]  [<c01b801b>] security_file_permission+0xc/0xd
[27942.274468]  [<c016fc68>] do_sync_write+0x0/0x100
[27942.275444]  [<c0170499>] vfs_write+0x83/0x120
[27942.276415]  [<c0170a6b>] sys_write+0x3c/0x63
[27942.277377]  [<c0103f76>] syscall_call+0x7/0xb
[27942.278336]  =======================
[31100.948195] INFO: task oscam:14435 blocked for more than 120 seconds.
[31100.949378] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31100.949378] oscam         D 00000044     0 14435      1
[31100.949378]        c0fe4ca0 00000282 00000001 00000044 00020050 c0fe4e28 c1231b40 00000000 
[31100.949378]        cf7d9e40 c018d96d 007500e1 c8c2f2a8 ce5e1440 cf82ea58 d1242170 00000001 
[31100.950452]        ce665c00 cf82ea58 0000aeae c0e95b4c c148f2b0 c012ed9b c0e95b4c c148f2b0 
[31100.951519] Call Trace:
[31100.953540]  [<c018d96d>] __find_get_block+0x198/0x1a2
[31100.954597]  [<d1242170>] __journal_file_buffer+0xa2/0x123 [jbd]
[31101.015279]  [<c012ed9b>] prepare_to_wait+0x12/0x49
[31101.016380]  [<d12426a0>] do_get_write_access+0x1b6/0x367 [jbd]
[31101.017450]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[31101.019221]  [<d1242869>] journal_get_write_access+0x18/0x26 [jbd]
[31101.020322]  [<d12815e7>] __ext3_journal_get_write_access+0x13/0x32 [ext3]
[31101.021419]  [<d127422b>] ext3_new_blocks+0x2d1/0x5b5 [ext3]
[31101.022501]  [<c017b7ce>] do_select+0x3a0/0x3bd
[31101.023583]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[31101.024675]  [<c0288415>] ip_finish_output+0x1c5/0x1fc
[31101.025768]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[31101.026866]  [<c018e755>] __block_prepare_write+0x164/0x366
[31101.027963]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[31101.029045]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31101.030127]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[31101.031281]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31101.032354]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[31101.033439]  [<c01caafa>] cap_inode_need_killpriv+0x25/0x35
[31101.034520]  [<c01b7ff4>] security_inode_need_killpriv+0xc/0xd
[31101.035661]  [<c014e0f1>] remove_suid+0x15/0x44
[31101.036811]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[31101.037914]  [<c017ebcb>] dput+0x16/0x109
[31101.038976]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[31101.040087]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[31101.041198]  [<c016fd27>] do_sync_write+0xbf/0x100
[31101.042305]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[31101.043448]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[31101.044614]  [<c01732bc>] sys_stat64+0x1e/0x23
[31101.286840]  [<c01b801b>] security_file_permission+0xc/0xd
[31101.288063]  [<c016fc68>] do_sync_write+0x0/0x100
[31101.289212]  [<c0170499>] vfs_write+0x83/0x120
[31101.290297]  [<c0170a6b>] sys_write+0x3c/0x63
[31101.291341]  [<c0103f76>] syscall_call+0x7/0xb
[31103.114254]  =======================
[31107.376918] INFO: task oscam:14515 blocked for more than 120 seconds.
[31107.378199] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31107.378721] oscam         D cf8d3dd8     0 14515      1
[31107.438754]        c0df5300 00000282 00000000 cf8d3dd8 c018d96d c0df5488 c1231b40 00000000 
[31107.438861]        cf7d9e40 de747443 00750718 0007842d 00000000 c0df5328 c0115357 ce72a800 
[31107.439999]        ce72a800 d0464880 00009595 c0e53af0 c148f964 c012ed9b c0e53af0 c148f964 
[31107.441121] Call Trace:
[31107.443272]  [<c018d96d>] __find_get_block+0x198/0x1a2
[31107.444407]  [<c0115357>] update_curr+0x47/0x79
[31107.445540]  [<c012ed9b>] prepare_to_wait+0x12/0x49
[31107.446798]  [<d12426a0>] do_get_write_access+0x1b6/0x367 [jbd]
[31107.447932]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[31107.449046]  [<d1242fc1>] journal_get_undo_access+0x25/0xf0 [jbd]
[31107.450150]  [<d1281619>] __ext3_journal_get_undo_access+0x13/0x32 [ext3]
[31107.451280]  [<d1273b53>] ext3_try_to_allocate_with_rsv+0x3c/0x443 [ext3]
[31107.452375]  [<d1276832>] ext3_mark_inode_dirty+0x20/0x27 [ext3]
[31107.453453]  [<d1274131>] ext3_new_blocks+0x1d7/0x5b5 [ext3]
[31107.454508]  [<c017b7ce>] do_select+0x3a0/0x3bd
[31107.455554]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[31107.456614]  [<c0288415>] ip_finish_output+0x1c5/0x1fc
[31107.457674]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[31107.459011]  [<c018e755>] __block_prepare_write+0x164/0x366
[31107.460089]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[31107.461168]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31107.462205]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[31107.463313]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31107.464409]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[31107.465520]  [<c01caafa>] cap_inode_need_killpriv+0x25/0x35
[31107.466575]  [<c01b7ff4>] security_inode_need_killpriv+0xc/0xd
[31107.467706]  [<c014e0f1>] remove_suid+0x15/0x44
[31107.708541]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[31107.709826]  [<c017ebcb>] dput+0x16/0x109
[31107.710954]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[31107.712075]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[31107.716474]  [<c016fd27>] do_sync_write+0xbf/0x100
[31107.717218]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[31107.717218]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[31107.717223]  [<c01732bc>] sys_stat64+0x1e/0x23
[31107.718302]  [<c01b801b>] security_file_permission+0xc/0xd
[31107.719374]  [<c016fc68>] do_sync_write+0x0/0x100
[31107.720419]  [<c0170499>] vfs_write+0x83/0x120
[31107.724667]  [<c0170a6b>] sys_write+0x3c/0x63
[31107.724895]  [<c0103f76>] syscall_call+0x7/0xb
[31146.593969]  =======================
[31229.786803] INFO: task oscam:14435 blocked for more than 120 seconds.
[31229.788098] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31229.789063] oscam         D 00000044     0 14435      1
[31229.789063]        c0fe4ca0 00000282 00000001 00000044 00020050 c0fe4e28 c1231b40 00000000 
[31229.789063]        cf7d9e40 c018d96d 007500e1 c8c2f2a8 ce5e1440 cf82ea58 d1242170 00000001 
[31229.790209]        ce665c00 cf82ea58 0000aeae c0e95b4c c148f2b0 c012ed9b c0e95b4c c148f2b0 
[31229.791341] Call Trace:
[31229.793459]  [<c018d96d>] __find_get_block+0x198/0x1a2
[31229.794762]  [<d1242170>] __journal_file_buffer+0xa2/0x123 [jbd]
[31229.795831]  [<c012ed9b>] prepare_to_wait+0x12/0x49
[31229.796875]  [<d12426a0>] do_get_write_access+0x1b6/0x367 [jbd]
[31229.797931]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[31229.798954]  [<d1242869>] journal_get_write_access+0x18/0x26 [jbd]
[31229.799987]  [<d12815e7>] __ext3_journal_get_write_access+0x13/0x32 [ext3]
[31229.801042]  [<d127422b>] ext3_new_blocks+0x2d1/0x5b5 [ext3]
[31229.802098]  [<c017b7ce>] do_select+0x3a0/0x3bd
[31229.803135]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[31229.804186]  [<c0288415>] ip_finish_output+0x1c5/0x1fc
[31229.805223]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[31229.806264]  [<c018e755>] __block_prepare_write+0x164/0x366
[31229.807310]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[31229.808345]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31229.809396]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[31230.020050]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31230.021148]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[31230.022225]  [<c01caafa>] cap_inode_need_killpriv+0x25/0x35
[31230.023302]  [<c01b7ff4>] security_inode_need_killpriv+0xc/0xd
[31230.024386]  [<c014e0f1>] remove_suid+0x15/0x44
[31230.025457]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[31230.026549]  [<c017ebcb>] dput+0x16/0x109
[31230.028391]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[31230.029527]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[31230.030647]  [<c016fd27>] do_sync_write+0xbf/0x100
[31230.031679]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[31230.032794]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[31230.033924]  [<c01732bc>] sys_stat64+0x1e/0x23
[31230.035048]  [<c01b801b>] security_file_permission+0xc/0xd
[31230.036173]  [<c016fc68>] do_sync_write+0x0/0x100
[31230.037267]  [<c0170499>] vfs_write+0x83/0x120
[31230.038335]  [<c0170a6b>] sys_write+0x3c/0x63
[31230.039371]  [<c0103f76>] syscall_call+0x7/0xb
[31232.013798]  =======================
[31236.229006] INFO: task oscam:14515 blocked for more than 120 seconds.
[31236.230261] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31236.230723] oscam         D cf8d3dd8     0 14515      1
[31236.230723]        c0df5300 00000282 00000000 cf8d3dd8 c018d96d c0df5488 c1231b40 00000000 
[31236.230723]        cf7d9e40 de747443 00750718 0007842d 00000000 c0df5328 c0115357 ce72a800 
[31236.231843]        ce72a800 d0464880 00009595 c0e53af0 c148f964 c012ed9b c0e53af0 c148f964 
[31236.232965] Call Trace:
[31236.295340]  [<c018d96d>] __find_get_block+0x198/0x1a2
[31236.296482]  [<c0115357>] update_curr+0x47/0x79
[31236.298755]  [<c012ed9b>] prepare_to_wait+0x12/0x49
[31236.299892]  [<d12426a0>] do_get_write_access+0x1b6/0x367 [jbd]
[31236.301054]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[31236.301054]  [<d1242fc1>] journal_get_undo_access+0x25/0xf0 [jbd]
[31236.302166]  [<d1281619>] __ext3_journal_get_undo_access+0x13/0x32 [ext3]
[31236.303300]  [<d1273b53>] ext3_try_to_allocate_with_rsv+0x3c/0x443 [ext3]
[31236.304430]  [<d1276832>] ext3_mark_inode_dirty+0x20/0x27 [ext3]
[31236.305679]  [<d1274131>] ext3_new_blocks+0x1d7/0x5b5 [ext3]
[31236.306721]  [<c017b7ce>] do_select+0x3a0/0x3bd
[31236.307757]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[31236.308814]  [<c0288415>] ip_finish_output+0x1c5/0x1fc
[31236.309872]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[31236.310942]  [<c018e755>] __block_prepare_write+0x164/0x366
[31236.312015]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[31236.313087]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31236.314190]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[31236.315284]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31236.316421]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[31236.317578]  [<c01caafa>] cap_inode_need_killpriv+0x25/0x35
[31236.318730]  [<c01b7ff4>] security_inode_need_killpriv+0xc/0xd
[31236.319820]  [<c014e0f1>] remove_suid+0x15/0x44
[31236.320944]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[31236.322055]  [<c017ebcb>] dput+0x16/0x109
[31236.323174]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[31236.444093]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[31236.445246]  [<c016fd27>] do_sync_write+0xbf/0x100
[31236.446374]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[31236.448050]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[31236.449155]  [<c01732bc>] sys_stat64+0x1e/0x23
[31236.450237]  [<c01b801b>] security_file_permission+0xc/0xd
[31236.451310]  [<c016fc68>] do_sync_write+0x0/0x100
[31236.452354]  [<c0170499>] vfs_write+0x83/0x120
[31236.453387]  [<c0170a6b>] sys_write+0x3c/0x63
[31236.454420]  [<c0103f76>] syscall_call+0x7/0xb
[31275.366564]  =======================
[31358.632625] INFO: task oscam:14435 blocked for more than 120 seconds.
[31358.633919] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31358.694767] oscam         D 00000044     0 14435      1
[31358.695935]        c0fe4ca0 00000282 00000001 00000044 00020050 c0fe4e28 c1231b40 00000000 
[31358.696016]        cf7d9e40 c018d96d 007500e1 c8c2f2a8 ce5e1440 cf82ea58 d1242170 00000001 
[31358.697207]        ce665c00 cf82ea58 0000aeae c0e95b4c c148f2b0 c012ed9b c0e95b4c c148f2b0 
[31358.698371] Call Trace:
[31358.700492]  [<c018d96d>] __find_get_block+0x198/0x1a2
[31358.700972]  [<d1242170>] __journal_file_buffer+0xa2/0x123 [jbd]
[31358.702046]  [<c012ed9b>] prepare_to_wait+0x12/0x49
[31358.703099]  [<d12426a0>] do_get_write_access+0x1b6/0x367 [jbd]
[31358.704155]  [<c012ecbd>] wake_bit_function+0x0/0x3c
[31358.705192]  [<d1242869>] journal_get_write_access+0x18/0x26 [jbd]
[31358.706237]  [<d12815e7>] __ext3_journal_get_write_access+0x13/0x32 [ext3]
[31358.707297]  [<d127422b>] ext3_new_blocks+0x2d1/0x5b5 [ext3]
[31358.708344]  [<c017b7ce>] do_select+0x3a0/0x3bd
[31358.709387]  [<d1276efd>] ext3_get_blocks_handle+0x37a/0x7cb [ext3]
[31358.710441]  [<c0288415>] ip_finish_output+0x1c5/0x1fc
[31358.711482]  [<d127756a>] ext3_get_block+0x9f/0xd3 [ext3]
[31358.712513]  [<c018e755>] __block_prepare_write+0x164/0x366
[31358.716665]  [<c018e9f4>] block_write_begin+0x7a/0xd7
[31358.716901]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31358.716901]  [<d12787fe>] ext3_write_begin+0xbe/0x16d [ext3]
[31358.716901]  [<d12774cb>] ext3_get_block+0x0/0xd3 [ext3]
[31358.717948]  [<c014f169>] generic_file_buffered_write+0xef/0x553
[31358.719013]  [<c01caafa>] cap_inode_need_killpriv+0x25/0x35
[31358.720110]  [<c01b7ff4>] security_inode_need_killpriv+0xc/0xd
[31358.721104]  [<c014e0f1>] remove_suid+0x15/0x44
[31358.722182]  [<c014fa35>] __generic_file_aio_write_nolock+0x468/0x4cb
[31358.902709]  [<c017ebcb>] dput+0x16/0x109
[31358.904154]  [<c014faea>] generic_file_aio_write+0x52/0xa9
[31358.905333]  [<d1275015>] ext3_file_write+0x19/0x83 [ext3]
[31358.906466]  [<c016fd27>] do_sync_write+0xbf/0x100
[31358.907680]  [<c0172c3c>] cp_new_stat64+0xfc/0x10e
[31358.908796]  [<c012ec90>] autoremove_wake_function+0x0/0x2d
[31358.909925]  [<c01732bc>] sys_stat64+0x1e/0x23
[31358.911678]  [<c01b801b>] security_file_permission+0xc/0xd
[31358.912898]  [<c016fc68>] do_sync_write+0x0/0x100
[31358.913996]  [<c0170499>] vfs_write+0x83/0x120
[31358.915053]  [<c0170a6b>] sys_write+0x3c/0x63
[31358.916128]  [<c0103f76>] syscall_call+0x7/0xb
[31360.875955]  =======================
[31365.159950] oscam[14812] general protection ip:80849b5 sp:b6e11d40 error:1db8 in oscam[8048000+92000]

Log are clear at this moment.

Change History (1)

comment:1 by Admin, 13 years ago

Resolution: invalid
Status: newclosed

This seems to be an issue of your linux kernel (seems to be caused by the scheduler) and not of OSCam and thus can't be fixed through OSCam. Do a search on google for "task blocked for more than 120 seconds" and you'll get tons of results for this problem.

Note: See TracTickets for help on using tickets.