Dave Chinner 0e7ab7efe7 xfs: Throttle commits on delayed background CIL push ... In certain situations the background CIL push can be indefinitely delayed. While we have workarounds from the obvious cases now, it doesn't solve the underlying issue. This issue is that there is no upper limit on the CIL where we will either force or wait for a background push to start, hence allowing the CIL to grow without bound until it consumes all log space. To fix this, add a new wait queue to the CIL which allows background pushes to wait for the CIL context to be switched out. This happens when the push starts, so it will allow us to block incoming transaction commit completion until the push has started. This will only affect processes that are running modifications, and only when the CIL threshold has been significantly overrun. This has no apparent impact on performance, and doesn't even trigger until over 45 million inodes had been created in a 16-way fsmark test on a 2GB log. That was limiting at 64MB of log space used, so the active CIL size is only about 3% of the total log in that case. The concurrent removal of those files did not trigger the background sleep at all. Signed-off-by: Dave Chinner <dchinner@redhat.com> Reviewed-by: Allison Collins <allison.henderson@oracle.com> Reviewed-by: Darrick J. Wong <darrick.wong@oracle.com> Signed-off-by: Darrick J. Wong <darrick.wong@oracle.com>		2020-03-27 08:32:54 -07:00
..
libxfs	xfs: validate the realtime geometry in xfs_validate_sb_common	2020-03-27 08:32:53 -07:00
scrub	xfs: prohibit fs freezing when using empty transactions	2020-03-26 08:19:24 -07:00
Kconfig	treewide: Add SPDX license identifier - Makefile/Kconfig	2019-05-21 10:50:46 +02:00
kmem.c	xfs: Correct comment tyops -> typos	2019-11-10 10:21:57 -08:00
kmem.h	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
Makefile	xfs: introduce fake roots for ag-rooted btrees	2020-03-18 08:12:23 -07:00
mrlock.h
xfs_acl.c	xfs: only allocate the buffer size actually needed in __xfs_set_acl	2020-03-02 20:55:55 -08:00
xfs_acl.h	xfs: improve xfs_forget_acl	2020-03-02 20:55:55 -08:00
xfs_aops.c	xfs: ratelimit xfs_discard_page messages	2020-03-02 20:55:51 -08:00
xfs_aops.h	xfs: add a xfs_inode_buftarg helper	2019-10-28 08:37:54 -07:00
xfs_attr_inactive.c	xfs: add a function to deal with corrupt buffers post-verifiers	2020-03-12 07:58:12 -07:00
xfs_attr_list.c	xfs: add a function to deal with corrupt buffers post-verifiers	2020-03-12 07:58:12 -07:00
xfs_bio_io.c	xfs: chain bios the right way around in xfs_rw_bdev	2019-07-10 10:04:16 -07:00
xfs_bmap_item.c	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
xfs_bmap_item.h	xfs: merge xfs_bud_init into xfs_trans_get_bud	2019-06-28 19:27:36 -07:00
xfs_bmap_util.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_bmap_util.h	xfs: simplify xfs_iomap_eof_align_last_fsb	2019-11-03 10:22:30 -08:00
xfs_buf_item.c	xfs: add a new xfs_sb_version_has_v3inode helper	2020-03-19 08:47:34 -07:00
xfs_buf_item.h	xfs: check log iovec size to make sure it's plausibly a buffer log format	2020-01-16 08:07:24 -08:00
xfs_buf.c	xfs: xfs_buf_corruption_error should take __this_address	2020-03-12 07:58:12 -07:00
xfs_buf.h	xfs: add a function to deal with corrupt buffers post-verifiers	2020-03-12 07:58:12 -07:00
xfs_dir2_readdir.c	xfs: fix regression in "cleanup xfs_dir2_block_getdents"	2020-03-13 10:37:13 -07:00
xfs_discard.c	xfs: remove XFS_BUF_TO_AGF	2020-03-11 09:11:39 -07:00
xfs_discard.h
xfs_dquot_item.c	xfs: fix unmount hang and memory leak on shutdown during quotaoff	2020-03-18 08:12:23 -07:00
xfs_dquot_item.h	xfs: factor out quotaoff intent AIL removal and memory free	2020-03-18 08:12:23 -07:00
xfs_dquot.c	xfs: remove the kuid/kgid conversion wrappers	2020-03-02 20:55:50 -08:00
xfs_dquot.h	xfs: remove the xfs_dq_logitem_t typedef	2019-11-13 18:22:26 -08:00
xfs_error.c	xfs: xfs_buf_corruption_error should take __this_address	2020-03-12 07:58:12 -07:00
xfs_error.h	xfs: xfs_buf_corruption_error should take __this_address	2020-03-12 07:58:12 -07:00
xfs_export.c	xfs: remove unused header files	2019-06-28 19:30:43 -07:00
xfs_export.h
xfs_extent_busy.c	xfs: cleanup use of the XFS_ALLOC_ flags	2019-11-03 10:22:31 -08:00
xfs_extent_busy.h
xfs_extfree_item.c	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
xfs_extfree_item.h	xfs: merge xfs_efd_init into xfs_trans_get_efd	2019-06-28 19:27:35 -07:00
xfs_file.c	xfs: fix IOCB_NOWAIT handling in xfs_file_dio_aio_read	2020-01-15 22:13:11 -08:00
xfs_filestream.c	xfs: make xfs_*read_agf return EAGAIN to ALLOC_FLAG_TRYLOCK callers	2020-01-26 14:32:26 -08:00
xfs_filestream.h
xfs_fsmap.c	xfs: prohibit fs freezing when using empty transactions	2020-03-26 08:19:24 -07:00
xfs_fsmap.h
xfs_fsops.c	xfs: remove unused header files	2019-06-28 19:30:43 -07:00
xfs_fsops.h	xfs: change some error-less functions to void types	2019-05-01 20:26:30 -07:00
xfs_globals.c	xfs: multithreaded iwalk implementation	2019-07-03 07:33:26 -07:00
xfs_health.c	xfs: introduce new v5 bulkstat structure	2019-07-03 20:36:26 -07:00
xfs_icache.c	xfs: ensure that the inode uid/gid match values match the icdinode ones	2020-03-02 20:55:50 -08:00
xfs_icache.h	xfs: rename the speculative block allocation reclaim toggle functions	2019-04-26 12:28:55 -07:00
xfs_icreate_item.c	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
xfs_icreate_item.h
xfs_inode_item.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_inode_item.h	xfs: remove the xfs_log_item_t typedef	2019-06-28 19:27:33 -07:00
xfs_inode.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_inode.h	xfs: merge the projid fields in struct xfs_icdinode	2019-11-13 11:13:45 -08:00
xfs_ioctl32.c	xfs: lift cursor copy in/out into xfs_ioc_attr_list	2020-03-02 20:55:54 -08:00
xfs_ioctl32.h	xfs: rename compat_time_t to old_time32_t	2020-01-06 08:57:36 -08:00
xfs_ioctl.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_ioctl.h	xfs: embedded the attrlist cursor into struct xfs_attr_list_context	2020-03-02 20:55:55 -08:00
xfs_iomap.c	xfs: change return value of xfs_inode_need_cow to int	2020-01-20 14:34:47 -08:00
xfs_iomap.h	xfs: simplify the xfs_iomap_write_direct calling	2019-11-03 10:22:30 -08:00
xfs_iops.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_iops.h
xfs_itable.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_itable.h	xfs: remove all *_ITER_ABORT values	2019-08-29 21:22:41 -07:00
xfs_iwalk.c	xfs: kill the XFS_WANT_CORRUPT_* macros	2019-11-12 17:19:02 -08:00
xfs_iwalk.h	xfs: remove all *_ITER_CONTINUE values	2019-08-30 22:43:56 -07:00
xfs_linux.h	xfs: clean up the attr flag confusion	2020-03-02 20:55:55 -08:00
xfs_log_cil.c	xfs: Throttle commits on delayed background CIL push	2020-03-27 08:32:54 -07:00
xfs_log_priv.h	xfs: Throttle commits on delayed background CIL push	2020-03-27 08:32:54 -07:00
xfs_log_recover.c	xfs: remove the di_version field from struct icdinode	2020-03-19 08:48:47 -07:00
xfs_log.c	xfs: remove some stale comments from the log code	2020-03-27 08:32:54 -07:00
xfs_log.h	xfs: refactor and split xfs_log_done()	2020-03-27 08:32:53 -07:00
xfs_message.c	xfs: make the assertion message functions take a mount parameter	2019-11-05 08:28:27 -08:00
xfs_message.h	xfs: make the assertion message functions take a mount parameter	2019-11-05 08:28:27 -08:00
xfs_mount.c	xfs: remove XFS_BUF_TO_SBP	2020-03-11 09:11:39 -07:00
xfs_mount.h	xfs: remove unused structure members & simple typedefs	2019-11-13 18:22:41 -08:00
xfs_mru_cache.c	fs: xfs: Remove KM_NOSLEEP and KM_SLEEP.	2019-08-26 12:06:22 -07:00
xfs_mru_cache.h
xfs_ondisk.h	xfs: make struct xfs_buf_log_format have a consistent size	2020-01-16 08:07:23 -08:00
xfs_pnfs.c	xfs: use super s_id instead of struct xfs_mount m_fsname	2019-11-05 08:28:25 -08:00
xfs_pnfs.h
xfs_pwork.c	xfs: poll waiting for quotacheck	2019-07-03 08:21:58 -07:00
xfs_pwork.h	xfs: poll waiting for quotacheck	2019-07-03 08:21:58 -07:00
xfs_qm_bhv.c	xfs: remove the xfs_disk_dquot_t and xfs_dquot_t	2019-11-13 11:13:45 -08:00
xfs_qm_syscalls.c	xfs: fix unmount hang and memory leak on shutdown during quotaoff	2020-03-18 08:12:23 -07:00
xfs_qm.c	xfs: preserve default grace interval during quotacheck	2020-03-26 08:19:24 -07:00
xfs_qm.h	xfs: quota: move to time64_t interfaces	2020-01-06 08:57:37 -08:00
xfs_quota.h	xfs: remove the icdinode di_uid/di_gid members	2020-03-02 20:55:50 -08:00
xfs_quotaops.c	xfs: quota: move to time64_t interfaces	2020-01-06 08:57:37 -08:00
xfs_refcount_item.c	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
xfs_refcount_item.h	xfs: merge xfs_cud_init into xfs_trans_get_cud	2019-06-28 19:27:35 -07:00
xfs_reflink.c	xfs: remove unnecessary null pointer checks from _read_agf callers	2020-01-26 14:32:27 -08:00
xfs_reflink.h	xfs: change return value of xfs_inode_need_cow to int	2020-01-20 14:34:47 -08:00
xfs_rmap_item.c	xfs: Remove kmem_zone_free() wrapper	2019-11-18 08:40:44 -08:00
xfs_rmap_item.h	xfs: merge xfs_rud_init into xfs_trans_get_rud	2019-06-28 19:27:36 -07:00
xfs_rtalloc.c	xfs: make xfs_trans_get_buf return an error code	2020-01-26 14:32:26 -08:00
xfs_rtalloc.h
xfs_stats.c	xfs: Use scnprintf() for avoiding potential buffer overflow	2020-03-12 07:58:13 -07:00
xfs_stats.h	xfs: use offsetof() in place of offset macros for __xfsstats	2018-10-18 17:21:39 +11:00
xfs_super.c	Merge branch 'merge.nfs-fs_parse.1' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs	2020-02-08 13:26:41 -08:00
xfs_super.h	xfs: include QUOTA, FATAL ASSERT build options in XFS_BUILD_OPTIONS	2019-10-21 09:04:57 -07:00
xfs_symlink.c	xfs: only check the superblock version for dinode size calculation	2020-03-19 08:48:47 -07:00
xfs_symlink.h	xfs: Correct comment tyops -> typos	2019-11-10 10:21:57 -08:00
xfs_sysctl.c	xfs: remove unused header files	2019-06-28 19:30:43 -07:00
xfs_sysctl.h	xfs: multithreaded iwalk implementation	2019-07-03 07:33:26 -07:00
xfs_sysfs.c	xfs: avoid unused to_mp() function warning	2019-09-24 09:40:19 -07:00
xfs_sysfs.h
xfs_trace.c	xfs: support bulk loading of staged btrees	2020-03-18 08:12:23 -07:00
xfs_trace.h	xfs: Throttle commits on delayed background CIL push	2020-03-27 08:32:54 -07:00
xfs_trans_ail.c	xfs: clear PF_MEMALLOC before exiting xfsaild thread	2020-03-11 09:11:38 -07:00
xfs_trans_buf.c	xfs: fix xfs_buf_ioerror_alert location reporting	2020-01-26 14:32:27 -08:00
xfs_trans_dquot.c	xfs: quota: move to time64_t interfaces	2020-01-06 08:57:37 -08:00
xfs_trans_priv.h	xfs: don't use xfs_trans_free_items in the commit path	2019-06-28 19:27:31 -07:00
xfs_trans.c	xfs: split xlog_ticket_done	2020-03-27 08:32:53 -07:00
xfs_trans.h	xfs: make xfs_trans_get_buf return an error code	2020-01-26 14:32:26 -08:00
xfs_xattr.c	xfs: embedded the attrlist cursor into struct xfs_attr_list_context	2020-03-02 20:55:55 -08:00
xfs.h	xfs: remove b_last_holder & associated macros	2018-08-12 08:37:31 -07:00