linux-stable.git/block/blk.h, branch linux-5.17.y

block: only build the icq tracking code when needed

2021-12-16T17:59:02+00:00

Only bfq needs to code to track icq, so make it conditional.

Signed-off-by: Christoph Hellwig 
Reviewed-by: Jan Kara 
Link: https://lore.kernel.org/r/20211209063131.18537-12-hch@lst.de
Signed-off-by: Jens Axboe

blk-mq: move srcu from blk_mq_hw_ctx to request_queue

2021-12-03T21:51:29+00:00

In case of BLK_MQ_F_BLOCKING, per-hctx srcu is used to protect dispatch
critical area. However, this srcu instance stays at the end of hctx, and
it often takes standalone cacheline, often cold.

Inside srcu_read_lock() and srcu_read_unlock(), WRITE is always done on
the indirect percpu variable which is allocated from heap instead of
being embedded, srcu->srcu_idx is read only in srcu_read_lock(). It
doesn't matter if srcu structure stays in hctx or request queue.

So switch to per-request-queue srcu for protecting dispatch, and this
way simplifies quiesce a lot, not mention quiesce is always done on the
request queue wide.

Signed-off-by: Ming Lei 
Link: https://lore.kernel.org/r/20211203131534.3668411-3-ming.lei@redhat.com
Signed-off-by: Jens Axboe

block: switch to atomic_t for request references

2021-12-03T21:51:29+00:00

refcount_t is not as expensive as it used to be, but it's still more
expensive than the io_uring method of using atomic_t and just checking
for potential over/underflow.

This borrows that same implementation, which in turn is based on the
mm implementation from Linus.

Reviewed-by: Keith Busch 
Signed-off-by: Jens Axboe

block: remove the ->rq_disk field in struct request

2021-11-29T13:41:29+00:00

Just use the disk attached to the request_queue instead.

Signed-off-by: Christoph Hellwig 
Reviewed-by: Chaitanya Kulkarni 
Reviewed-by: Martin K. Petersen 
Link: https://lore.kernel.org/r/20211126121802.2090656-4-hch@lst.de
Signed-off-by: Jens Axboe

block: simplify ioc_lookup_icq

2021-11-29T13:41:29+00:00

Remove the ioc argument as it always points to current->io_context.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211126115817.2087431-15-hch@lst.de
Signed-off-by: Jens Axboe

block: move blk_mq_sched_assign_ioc to blk-ioc.c

2021-11-29T13:41:29+00:00

Move blk_mq_sched_assign_ioc so that many interfaces from the file can
be marked static.  Rename the function to ioc_find_get_icq as well and
return the icq to simplify the interface.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211126115817.2087431-8-hch@lst.de
Signed-off-by: Jens Axboe

block: don't include in blk.h

2021-11-29T13:38:44+00:00

Not needed, shift it into the source files that need it instead.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211123185312.1432157-9-hch@lst.de
Signed-off-by: Jens Axboe

block: don't include in blk.h

2021-11-29T13:38:44+00:00

Not needed.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211123185312.1432157-8-hch@lst.de
Signed-off-by: Jens Axboe

block: don't include in blk.h

2021-11-29T13:38:44+00:00

Not needed.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211123185312.1432157-7-hch@lst.de
Signed-off-by: Jens Axboe

block: don't include blk-mq.h in blk.h

2021-11-29T13:38:44+00:00

No needed, shift a blk-stat.h include into the source file that needs it
instead.

Signed-off-by: Christoph Hellwig 
Link: https://lore.kernel.org/r/20211123185312.1432157-6-hch@lst.de
Signed-off-by: Jens Axboe