drm/vc4: Binner BO management improvements
Subsystems (3)
v3 cover drm/vc4: Binner BO management improvements
Changes since v2:
* Removed deprecated sentence about fristopen;
* Added collected Reviewed-By tags.
Changes since v1:
* Squashed the two final patches into one.
Paul Kocialkowski (2):
drm/file: Rehabilitate the firstopen hook for non-legacy drivers drm/vc4: Allocated/liberate the binner BO at firstopen/lastclose
drivers/gpu/drm/drm_file.c | 3 +-- drivers/gpu/drm/vc4/vc4_drv.c | 26 ++++++++++++++++++++++++++ drivers/gpu/drm/vc4/vc4_drv.h | 1 + drivers/gpu/drm/vc4/vc4_irq.c | 3 +++ drivers/gpu/drm/vc4/vc4_v3d.c | 15 +-------------- include/drm/drm_drv.h | 3 --- 6 files changed, 32 insertions(+), 19 deletions(-)
Signature · 1 line
2.21.0
PATCH v3 1/2 drm/file: Rehabilitate the firstopen hook for non-legacy drivers
The firstopen DRM driver hook was initially used to perform hardware initialization, which is now considered legacy. Only a single user of firstopen remains at this point (savage).
In some specific cases, non-legacy drivers may also need to implement these hooks. For instance on VC4, we need to allocate a 16 MiB buffer for the GPU. Because it's not required for fbcon, it's a waste to allocate it before userspace starts using the DRM device.
Using firstopen and lastclose for this allocation seems like the best fit, so re-habilitate the hook to allow it to be called for non-legacy drivers.
--- drivers/gpu/drm/drm_file.c | 3 +-- include/drm/drm_drv.h | 3 --- 2 files changed, 1 insertion(+), 5 deletions(-)
drivers/gpu/drm/drm_file.c +1 -2
@@ -266,8 +266,7 @@ static int drm_setup(struct drm_device * dev) {int ret; -if (dev->driver->firstopen && -drm_core_check_feature (dev,DRIVER_LEGACY )) { +if (dev->driver->firstopen) { ret = dev->driver->firstopen (dev);if (ret !=0 )return ret;
include/drm/drm_drv.h +0 -3
@@ -234,9 +234,6 @@ struct drm_driver {* kernel driver does not really own the hardware. Instead ownershipe is * handled with the help of userspace through an inheritedly racy dance * to set/unset the VT into raw mode. -* -* Legacy drivers initialize the hardware in the @firstopen callback, -* which isn't even called for modern drivers. */ void (*lastclose) (struct drm_device *);
Signature · 6 lines
2.21.0 _______________________________________________ dri-devel mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/dri-devel
Re: [PATCH v3 1/2] drm/file: Rehabilitate the firstopen hook for non-legacy drivers
Quoted 25 lines · Paul Kocialkowski
The firstopen DRM driver hook was initially used to perform hardware initialization, which is now considered legacy. Only a single user of firstopen remains at this point (savage).
In some specific cases, non-legacy drivers may also need to implement these hooks. For instance on VC4, we need to allocate a 16 MiB buffer for the GPU. Because it's not required for fbcon, it's a waste to allocate it before userspace starts using the DRM device.
Using firstopen and lastclose for this allocation seems like the best fit, so re-habilitate the hook to allow it to be called for non-legacy drivers.
Signed-off-by Paul Kocialkowski <[email protected]>Reviewed-by Eric Anholt <[email protected]>--- drivers/gpu/drm/drm_file.c | 3 +-- include/drm/drm_drv.h | 3 --- 2 files changed, 1 insertion(+), 5 deletions(-)drivers/gpu/drm/drm_file.c +0
-0
drivers/gpu/drm/drm_file.c static int drm_setup(struct drm_device * dev) · line 269
Quoted 6 lines
drivers/gpu/drm/drm_file.c +1
-2@@ -266,8 +266,7 @@ static int drm_setup(struct drm_device * dev) {int ret; -if (dev->driver->firstopen && -drm_core_check_feature (dev,DRIVER_LEGACY )) { +if (dev->driver->firstopen) {
If you guys insist on this (still not a fan myself) pls pull it out of drm_setup - that's all just legacy hw setup in there. I still think tracking this a bit more accurately (if you want to bother with this) would be better.
-Daniel
Quoted 20 lines
drivers/gpu/drm/drm_file.c +0
-0ret = dev->driver->firstopen (dev);if (ret !=0 )return ret;include/drm/drm_drv.h +0
-3@@ -234,9 +234,6 @@ struct drm_driver {* kernel driver does not really own the hardware. Instead ownershipe is * handled with the help of userspace through an inheritedly racy dance * to set/unset the VT into raw mode. -* -* Legacy drivers initialize the hardware in the @firstopen callback, -* which isn't even called for modern drivers. */ void (*lastclose) (struct drm_device *);Signature · 1 line
2.21.0
Signature · 3 lines
Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch
Re: [PATCH v3 1/2] drm/file: Rehabilitate the firstopen hook for non-legacy drivers
Quoted 29 lines · Daniel Vetter
Quoted 28 lines · Paul Kocialkowski
The firstopen DRM driver hook was initially used to perform hardware initialization, which is now considered legacy. Only a single user of firstopen remains at this point (savage).
In some specific cases, non-legacy drivers may also need to implement these hooks. For instance on VC4, we need to allocate a 16 MiB buffer for the GPU. Because it's not required for fbcon, it's a waste to allocate it before userspace starts using the DRM device.
Using firstopen and lastclose for this allocation seems like the best fit, so re-habilitate the hook to allow it to be called for non-legacy drivers.
Signed-off-by Paul Kocialkowski <[email protected]>Reviewed-by Eric Anholt <[email protected]>--- drivers/gpu/drm/drm_file.c | 3 +-- include/drm/drm_drv.h | 3 --- 2 files changed, 1 insertion(+), 5 deletions(-)drivers/gpu/drm/drm_file.c +0
-0@@ -266,8 +266,7 @@ static int drm_setup(struct drm_device * dev) {int ret;
Quoted 8 lines
drivers/gpu/drm/drm_file.c static int drm_setup(struct drm_device * dev) · line 269
Quoted 3 lines
drivers/gpu/drm/drm_file.c +1
-2-if (dev->driver->firstopen && -drm_core_check_feature (dev,DRIVER_LEGACY )) { +if (dev->driver->firstopen) {If you guys insist on this (still not a fan myself) pls pull it out of
drm_setup- that's all just legacy hw setup in there. I still think tracking this a bit more accurately (if you want to bother with this) would be better.
Maybe another one: Firstopen is called after ->open, which might be confusing. But we can't change that ever because legacy drivers surely rely on that somewhere (like the backwards load/unload calling sequence). -Daniel
Signature · 3 lines
Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch
Re: [PATCH v3 1/2] drm/file: Rehabilitate the firstopen hook for non-legacy drivers
In reply to Daniel VetterHi Daniel,
Quoted 29 lines · Daniel Vetter
Quoted 28 lines · Paul Kocialkowski
The firstopen DRM driver hook was initially used to perform hardware initialization, which is now considered legacy. Only a single user of firstopen remains at this point (savage).
In some specific cases, non-legacy drivers may also need to implement these hooks. For instance on VC4, we need to allocate a 16 MiB buffer for the GPU. Because it's not required for fbcon, it's a waste to allocate it before userspace starts using the DRM device.
Using firstopen and lastclose for this allocation seems like the best fit, so re-habilitate the hook to allow it to be called for non-legacy drivers.
Signed-off-by Paul Kocialkowski <[email protected]>Reviewed-by Eric Anholt <[email protected]>--- drivers/gpu/drm/drm_file.c | 3 +-- include/drm/drm_drv.h | 3 --- 2 files changed, 1 insertion(+), 5 deletions(-)drivers/gpu/drm/drm_file.c +0
-0@@ -266,8 +266,7 @@ static int drm_setup(struct drm_device * dev) {int ret;
Quoted 8 lines
drivers/gpu/drm/drm_file.c static int drm_setup(struct drm_device * dev) · line 269
Quoted 3 lines
drivers/gpu/drm/drm_file.c +1
-2-if (dev->driver->firstopen && -drm_core_check_feature (dev,DRIVER_LEGACY )) { +if (dev->driver->firstopen) {If you guys insist on this (still not a fan myself) pls pull it out of
drm_setup- that's all just legacy hw setup in there. I still think tracking this a bit more accurately (if you want to bother with this) would be better.
I sent out this v3 right before receiving your comments on v2, so this new iteration only takes Eric's comments into account.
I think the points you made on v2 are very legitimate and I'll be working to prepare a new series that takes them into consideration :)
Cheers,
Paul
Quoted 22 lines
-Daniel
Quoted 20 lines
drivers/gpu/drm/drm_file.c +0
-0ret = dev->driver->firstopen (dev);if (ret !=0 )return ret;include/drm/drm_drv.h +0
-3@@ -234,9 +234,6 @@ struct drm_driver {* kernel driver does not really own the hardware. Instead ownershipe is * handled with the help of userspace through an inheritedly racy dance * to set/unset the VT into raw mode. -* -* Legacy drivers initialize the hardware in the @firstopen callback, -* which isn't even called for modern drivers. */ void (*lastclose) (struct drm_device *);Signature · 1 line
2.21.0
Signature · 3 lines
Paul Kocialkowski, Bootlin Embedded Linux and kernel engineering https://bootlin.com
PATCH v3 2/2 drm/vc4: Allocated/liberate the binner BO at firstopen/lastclose
In reply to Paul KocialkowskiThe binner BO is a pre-requisite to GPU operations, so we must ensure that it is always allocated when the GPU is in use. Currently, we are allocating it at probe time and liberating/allocating it during runtime pm cycles.
First, since the binner buffer is only required for GPU rendering, it's a waste to allocate it when the driver probes since internal users of the driver (such as fbcon) won't try to use the GPU.
Move the allocation/liberation to the firstopen/lastclose instead to only allocate it when userspace has opened the device and adapt the IRQ handler to return early when no binner BO was allocated yet.
Second, because the buffer is allocated from the same pool as other GPU buffers, we might run into a situation where we are out of memory at runtime resume. This causes the binner BO allocation to fail and results in all subsequent operations to fail, resulting in a major hang in userspace.
As a result, keep the buffer alive during runtime pm.
--- drivers/gpu/drm/vc4/vc4_drv.c | 26 ++++++++++++++++++++++++++ drivers/gpu/drm/vc4/vc4_drv.h | 1 + drivers/gpu/drm/vc4/vc4_irq.c | 3 +++ drivers/gpu/drm/vc4/vc4_v3d.c | 15 +-------------- 4 files changed, 31 insertions(+), 14 deletions(-)
drivers/gpu/drm/vc4/vc4_drv.c +26 -0
@@ -134,6 +134,30 @@ static void vc4_close(struct drm_device *dev, struct drm_file *file)kfree (vc4file); } +static int vc4_firstopen (struct drm_device *drm) +{ +struct vc4_dev *vc4 =to_vc4_dev (drm); +int ret; + +if (!vc4->bin_bo) { + ret =vc4_allocate_bin_bo (drm); +if (ret) +return ret; + } + +return 0 ; +} + +static void vc4_lastclose (struct drm_device *drm) +{ +struct vc4_dev *vc4 =to_vc4_dev (drm); + +if (vc4->bin_bo) { +drm_gem_object_put_unlocked (&vc4->bin_bo->base.base); + vc4->bin_bo =NULL ; + } +} +static const struct vm_operations_struct vc4_vm_ops = { .fault = vc4_fault, .open = drm_gem_vm_open,
@@ -180,6 +204,8 @@ static struct drm_driver vc4_drm_driver = { DRIVER_SYNCOBJ), .open = vc4_open, .postclose = vc4_close, + .firstopen = vc4_firstopen, + .lastclose = vc4_lastclose, .irq_handler = vc4_irq, .irq_preinstall = vc4_irq_preinstall, .irq_postinstall = vc4_irq_postinstall,
drivers/gpu/drm/vc4/vc4_drv.h +1 -0
@@ -808,6 +808,7 @@ extern struct platform_driver vc4_v3d_driver;int vc4_v3d_debugfs_ident (struct seq_file *m,void *unused);int vc4_v3d_debugfs_regs (struct seq_file *m,void *unused);int vc4_v3d_get_bin_slot (struct vc4_dev *vc4); +int vc4_allocate_bin_bo (struct drm_device *drm);/* vc4_validate.c */ int
drivers/gpu/drm/vc4/vc4_irq.c +3 -0
@@ -64,6 +64,9 @@ vc4_overflow_mem_work(struct work_struct *work)struct vc4_exec_info *exec;unsigned long irqflags; +if (!bo) +return ; + bin_bo_slot =vc4_v3d_get_bin_slot (vc4);if (bin_bo_slot <0 ) {DRM_ERROR ("Couldn't allocate binner overflow mem\n" );
drivers/gpu/drm/vc4/vc4_v3d.c +1 -14
@@ -218,7 +218,7 @@ int vc4_v3d_get_bin_slot(struct vc4_dev *vc4)* overall CMA pool before they make scenes complicated enough to run * out of bin space. */ -static int vc4_allocate_bin_bo (struct drm_device *drm) +int vc4_allocate_bin_bo (struct drm_device *drm) {struct vc4_dev *vc4 =to_vc4_dev (drm);struct vc4_v3d *v3d = vc4->v3d;
@@ -303,9 +303,6 @@ static int vc4_v3d_runtime_suspend(struct device *dev)vc4_irq_uninstall (vc4->dev); -drm_gem_object_put_unlocked (&vc4->bin_bo->base.base); - vc4->bin_bo =NULL ; -clk_disable_unprepare (v3d->clk);return 0 ;
@@ -317,10 +314,6 @@ static int vc4_v3d_runtime_resume(struct device *dev)struct vc4_dev *vc4 = v3d->vc4;int ret; - ret =vc4_allocate_bin_bo (vc4->dev); -if (ret) -return ret; - ret =clk_prepare_enable (v3d->clk);if (ret !=0 )return ret;
@@ -384,12 +377,6 @@ static int vc4_v3d_bind(struct device *dev, struct device *master, void *data)if (ret !=0 )return ret; - ret =vc4_allocate_bin_bo (drm); -if (ret) { -clk_disable_unprepare (v3d->clk); -return ret; - } -/* Reset the binner overflow address/size at setup, to be sure * we don't reuse an old one. */
Signature · 1 line
2.21.0