Jens Axboe adeaa3f290 io_uring/io-wq: clear current->worker_private on exit ... A recent fix stopped clearing PF_IO_WORKER from current->flags on exit, which meant that we can now call inc/dec running on the worker after it has been removed if it ends up scheduling in/out as part of exit. If this happens after an RCU grace period has passed, then the struct pointed to by current->worker_private may have been freed, and we can now be accessing memory that is freed. Ensure this doesn't happen by clearing the task worker_private field. Both io_wq_worker_running() and io_wq_worker_sleeping() check this field before going any further, and we don't need any accounting etc done after this worker has exited. Fixes: fd37b88400 ("io_uring/io-wq: don't clear PF_IO_WORKER on exit") Reported-by: Zorro Lang <zlang@redhat.com> Signed-off-by: Jens Axboe <axboe@kernel.dk>		2023-06-14 12:54:55 -06:00
..
advise.c	io_uring: always go async for unsupported fadvise flags	2023-01-29 15:18:26 -07:00
advise.h
alloc_cache.h	io_uring/rsrc: consolidate node caching	2023-04-12 12:09:41 -06:00
cancel.c	io_uring/cancel: re-grab ctx mutex after finishing wait	2022-12-21 13:31:40 -07:00
cancel.h
epoll.c	io_uring: undeprecate epoll_ctl support	2023-05-26 20:22:41 -06:00
epoll.h
fdinfo.c	capability: just use a 'u64' instead of a 'u32[2]' array	2023-03-01 10:01:22 -08:00
fdinfo.h
filetable.c	io_uring/rsrc: merge nodes and io_rsrc_put	2023-04-18 19:38:26 -06:00
filetable.h	io_uring: kill hot path fixed file bitmap debug checks	2022-10-16 17:07:53 -06:00
fs.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
fs.h
io_uring.c	for-6.4/io_uring-2023-04-21	2023-04-26 12:40:31 -07:00
io_uring.h	io_uring: Create a helper to return the SQE size	2023-05-04 08:19:05 -06:00
io-wq.c	io_uring/io-wq: clear current->worker_private on exit	2023-06-14 12:54:55 -06:00
io-wq.h
kbuf.c	for-6.4/io_uring-2023-04-21	2023-04-26 12:40:31 -07:00
kbuf.h	io_uring: add support for user mapped provided buffer ring	2023-04-03 07:14:21 -06:00
Makefile
msg_ring.c	io_uring/msg_ring: let target know allocated index	2023-03-16 07:16:56 -06:00
msg_ring.h	io_uring: get rid of double locking	2022-12-07 06:47:13 -07:00
net.c	io_uring/net: save msghdr->msg_control for retries	2023-06-13 19:26:42 -06:00
net.h	io_uring: Add KASAN support for alloc_caches	2023-04-03 07:16:14 -06:00
nop.c
nop.h
notif.c	io_uring/notif: add constant for ubuf_info flags	2023-04-15 14:21:04 -06:00
notif.h	io_uring/notif: add constant for ubuf_info flags	2023-04-15 14:21:04 -06:00
opdef.c	io_uring: Pass whole sqe to commands	2023-05-04 08:19:05 -06:00
opdef.h	io_uring: Split io_issue_def struct	2023-01-29 15:17:41 -07:00
openclose.c	io_uring: always go async for unsupported open flags	2023-01-29 15:18:26 -07:00
openclose.h
poll.c	io_uring: encapsulate task_work state	2023-04-03 07:16:15 -06:00
poll.h	io_uring/poll: allow some retries for poll triggering spuriously	2023-02-25 20:10:13 -07:00
refs.h
rsrc.c	for-6.4/io_uring-2023-05-07	2023-05-07 10:00:09 -07:00
rsrc.h	io_uring/rsrc: disassociate nodes and rsrc_data	2023-04-18 19:38:26 -06:00
rw.c	for-6.4/block-2023-04-21	2023-04-26 12:52:58 -07:00
rw.h	io_uring/rw: don't lose partial IO result on fail	2022-09-21 13:15:02 -06:00
slist.h	io_uring: silence variable ‘prev’ set but not used warning	2023-03-09 10:10:58 -07:00
splice.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
splice.h
sqpoll.c	io_uring: unlock sqd->lock before sq thread release CPU	2023-05-25 09:30:13 -06:00
sqpoll.h	io_uring: make io_sqpoll_wait_sq return void	2023-01-29 15:17:40 -07:00
statx.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
statx.h
sync.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
sync.h
tctx.c	io_uring: rename 'in_idle' to 'in_cancel'	2023-02-22 09:57:23 -07:00
tctx.h	io_uring: simplify __io_uring_add_tctx_node	2022-10-07 12:25:30 -06:00
timeout.c	io_uring: add support for multishot timeouts	2023-04-18 19:38:36 -06:00
timeout.h	io_uring: remove unused return from io_disarm_next	2022-09-21 13:15:01 -06:00
uring_cmd.c	io_uring: Remove unnecessary BUILD_BUG_ON	2023-05-04 08:19:05 -06:00
uring_cmd.h	io_uring: Remove unnecessary BUILD_BUG_ON	2023-05-04 08:19:05 -06:00
xattr.c	io_uring: for requests that require async, force it	2023-01-29 15:18:26 -07:00
xattr.h