Difference between revisions of "How to start the coprocessor from the bootloader"

[quality revision] [quality revision]
m (Start from a generic DISTRO boot script)
m
 


1 Introduction[edit]

The coprocessor firmware can be loaded and started:

This article explains how the coprocessor firmware is loaded by U-Boot and started before the Linux kernel.

2 Location of the coprocessor firmware[edit]

U-Boot searches and loads the required binaries in the first bootable partition (generic DISTRO configuration) which is bootfs in the OpenSTLinux distribution (see STM32MP15_Flash_mapping), so the coprocessor firmware must be installed in that bootfs partition. The simplest way to do it consists in copying the firmware from the rootfs partition to the bootfs partition as follows:

Board $> mount /dev/mmcblk0p4 /boot
Board $> cp rproc-m4-fw.elf /boot/
Board $> sync

As an alternative method, you can use the Eclipse IDE, or transfer the firmware over the serial console or over the network.

Note: The default name of the firmware used in this WIKI is rproc-m4-fw.elf.

3 Starting the coprocessor firmware[edit]

U-Boot can boot the coprocessor before the kernel (coprocessor early boot) with remoteproc uclass . Several methods are possible:

  1. Manual start by using rproc commands
  2. Automatic start, at each boot by using

3.1 Manual start[edit]

You can load and start the coprocessor firmware by using the rproc command in the U-Boot console (to access to the U-boot console, press any key during the U-Boot execution).

 
Board $> rproc
 rproc - Control operation of remote processors in an SoC
 
 Usage:
 rproc  [init|list|load|start|stop|reset|is_running|ping]
 		 Where:
 		[addr] is a memory address
 		<id> is a numerical identifier for the remote processor
 		     provided by 'list' command.
 		Note: Remote processors must be initalized prior to usage
 		Note: Services depend on the driver capability
 		      'list' command shows the capability of each device
 
 	Subcommands:
 	init   - Enumerates and initializes the remote processors
 	list   - lists available remote processors
 	load <id> [addr] [size]- Loads the remote processor with
 			  image stored at address [addr] in memory
 	start <id>	- Starts the remote processor(must be loaded)
 	stop <id>	- Stops the remote processor
 	reset <id>	- Resets the remote processor
 	is_running <id> - Reports if the remote processor is running
 	ping <id>	- Pings the remote processor for communication

In this example, the firmware is loaded from an SD card into RAM (at ${kernel_addr_r}), and then launched.

Board $> ext4load mmc 0:4 ${kernel_addr_r} rproc-m4-fw.elf -> SD card is mmc 0, bootfs is ext4 partition number 4)
Board $> rproc init                                        -> initializes all coprocessors
Board $> rproc load 0 ${kernel_addr_r} ${filesize}         -> loads firmware for coprocessor 0 (code part found in .elf)
Board $> rproc start 0                                     -> starts coprocessor 0

You can then resume the normal boot process:

Board $> run bootcmd

3.2 Automatic start[edit]

3.2.1 Start from the bootcmd[edit]

You can update the bootcmd which is exectued automatically: modify CONFIG_EXTRA_ENV_SETTINGS in include/configs/stm32mp1.h and then recompile U-Boot.

For example, to boot a firmware from an SD card, proceed as follows:

#define CONFIG_EXTRA_ENV_SETTINGS \
	"stdin=serial\0" \
	"stdout=serial\0" \
	"stderr=serial\0" \
	...
	BOOTENV \
	"m4fw_name=rproc-m4-fw.elf\0" \
        "m4fw_addr=${kernel_addr_r}\0" \
	"boot_m4fw=rproc init; rproc load 0 ${m4fw_addr} ${filesize}; rproc start 0\0" \
        "boot_m4_mmc0=if ext4load mmc 0:4 ${m4fw_addr} ${m4fw_name} ; then run boot_m4fw; fi;\0"
        "bootcmd=run boot_m4_mmc0; run bootcmd_mmc0\0"

Note: It is recommended to check STM32MP15_U-Boot for compilation.

3.2.2 Start from a generic DISTRO boot script[edit]

Without U-boot recompilation, you can also use a DISTRO boot script boot.scr.uimg to automatically load and run the firmware.

For example, use the following script to boot from mmc 0, boot.scr.cmd:

 env set m4fw_name "rproc-m4-fw.elf"
 env set m4fw_addr ${kernel_addr_r}
 
 #load M4 firmware
 if ext4load mmc 0:4 ${m4fw_addr} ${m4fw_name}
 then
   rproc init
   rproc load 0 ${m4fw_addr} ${filesize}
   rproc start 0
 fi
 
 #load kernel and device tree
 ext4load mmc 0:4 ${kernel_addr_r} uImage
 ext4load mmc 0:4 ${fdt_addr_r}  ${board_name}.dtb
 
 # start kernel 
 env set bootargs root=/dev/mmcblk0p6 rootwait rw console=ttySTM0,115200
 bootm ${kernel_addr_r} - ${fdt_addr_r}

Then generate the associated image using mkimage U-Boot tool:

PC $> mkimage -T script -C none -A arm -d boot.scr.cmd boot.scr.uimg

Lastly, install boot.scr.uimg in the bootfs partition (following the same procedure used for coprocessor firmware)

PC $> sudo cp boot.scr.uimg /media/$USER/bootfs
PC $> sync
Warning.png The 'boot.scr.uimg' U-Boot script is executed only if 'extlinux/extlinux.conf' is not found (scan_dev_for_scripts is called after scan_dev_for_extlinux)
You should remove pre-existing file in bootfs partition:
PC $> sudo rm -r /media/$USER/bootfs/extlinux
PC $> sync

3.2.3 Start from the FIT image[edit]

The coprocessor firmware can also be included in the new U-Boot image format, Flattened uImage Tree (FIT) . This firmware is then automatically loaded when it is detected by U-Boot.

Info.png Please note that the upstreaming of this example is in progress, only a part of the files are present in the U-boot sources provided by STMicroelectronics

Refer to chapter 'Coprocessor firmware' in board/st/stm32mp1/README : it contains an example of '.its' file, <U-Boot directory>/board/st/stm32mp1/fit_copro_kernel_dtb.its, and shows how to generate the FIT with U-Boot mkimage tool:

PC $> mkimage -f fit_copro_kernel_dtb.its fit_copro_kernel_dtb.itb

You can load the generated FIT using:

To go deeper, read:

4 Synchronizing the remote firmware with Linux[edit]

The STM32MPU Embedded Software distribution provides the ability to detect and manage a firmware loaded by U-Boot thanks to the remoteproc Linux framework.
The developer must pay attention to how he implements the Arm Cortex-M4 firmware if the RPMsg is used to communicate with Linux. In this case a synchronization is required. The Arm Cortex-M4 core has to wait until Linux is booted to start RPMsg communications. When Linux is ready, the Linux kernel automatically updates the vdev status in the resource table, and sends a signal to the Arm Cortex-M4 core using the IPCC peripheral.
Two methods can be implemented to wait for the synchronization:

  • Blocking method: the firmware is blocked on MX_OPENAMP_Init call (by the rproc_virtio_wait_remote_ready function) until the Linux kernel is ready to communicate (update of the vdev status in the resource table).
  • Non-blocking method: when it is ready to communicate, the Linux kernel generates an interrupt towards the Arm Cortex-M4 core using the IPCC peripheral. This interrupt can be used by the Arm Cortex-M4 firmware to initialize the OpenAMP middleware and start the RPMsg protocol.


<noinclude>

{{ClonedFrom | stm32mpu}}</noinclude>

== Introduction ==
The [[Coprocessor_management_overview|coprocessor]] firmware can be loaded and started:
* either by the second stage bootloader, U-Boot (see [[Boot_chainschain_overview]] for details) or
* by the Linux<sup>&reg;</sup> kernel (see [[Linux_remoteproc_framework_overview]] for details)

This article explains how the coprocessor firmware is loaded by [[U-Boot_overview|U-Boot]] and started before the Linux kernel.

== Location of the coprocessor firmware ==

U-Boot searches and loads the required binaries in the first bootable partition ([[U-Boot_overview#Generic_Distro_configuration|generic DISTRO configuration]]) which is '''bootfs''' in the  OpenSTLinux distribution (see [[STM32MP15_Flash_mapping]]), so the coprocessor firmware must be installed in that bootfs partition. The simplest way to do it consists in copying the firmware from the rootfs partition to the bootfs partition as follows:
 {{Board$}} mount /dev/mmcblk0p4 /boot
 {{Board$}} cp rproc-m4-fw.elf /boot/
 {{Board$}} sync

As an alternative method, you can use the Eclipse IDE, or transfer the firmware [[How to transfer a file over serial console|over the serial console]] or [[How to transfer a file over network|over the network]].

''Note: The default name of the firmware used in this WIKI is '''rproc-m4-fw.elf'''''.

== Starting the coprocessor firmware ==

U-Boot can boot the coprocessor before the kernel (coprocessor early boot) with remoteproc {{CodeSource|U-Boot|doc/driver-model/README.txt|uclass}}. Several methods are possible:

# [[#Manual start|Manual start]] by using rproc commands
# [[#Automatic start|Automatic start]], at each boot by using 
#* [[#Start from the bootcmd|the bootcmd]] (needing U-Boot recompilation)
#* [[#Start from a generic DISTRO boot script|a generic DISTRO boot script]]
#* [[#Start from the FIT image|the FIT image]]

=== Manual start ===
You can load and start the coprocessor firmware by using the '''rproc''' command in the [[U-Boot_overview#U-Boot_command_line_interface_(CLI)|U-Boot console]] (to access to the U-boot console, press any key during the U-Boot execution).

  {{Board$}} rproc
  rproc - Control operation of remote processors in an SoC

  Usage:
  rproc  [init|list|load|start|stop|reset|is_running|ping]
  		 Where:
  		[addr] is a memory address<id> is a numerical identifier for the remote processor
  		     provided by 'list' command.
  		Note: Remote processors must be initalized prior to usage
  		Note: Services depend on the driver capability
  		      'list' command shows the capability of each device

  	Subcommands:
  	init   - Enumerates and initializes the remote processors
  	list   - lists available remote processors
  	load <id> [addr] [size]- Loads the remote processor with
  			  image stored at address [addr] in memory
  	start <id>	- Starts the remote processor(must be loaded)
  	stop <id>	- Stops the remote processor
  	reset <id>	- Resets the remote processor
  	is_running <id> - Reports if the remote processor is running
  	ping <id>	- Pings the remote processor for communication

In this example, the firmware is loaded from an SD card into RAM (at ${kernel_addr_r}), and then launched.

 {{Board$}} ext4load mmc 0:4 ${kernel_addr_r} rproc-m4-fw.elf {{Highlight|-> SD card is mmc 0, bootfs is ext4 partition number 4)}}
 {{Board$}} rproc init                                        {{Highlight|-> initializes all coprocessors}}
 {{Board$}} rproc load 0 ${kernel_addr_r} ${filesize}         {{Highlight|-> loads firmware for coprocessor 0 (code part found in .elf)}}
 {{Board$}} rproc start 0                                     {{Highlight|-> starts coprocessor 0}}

You can then resume the normal boot process:
 {{Board$}} run bootcmd

=== Automatic start ===
==== Start from the bootcmd ====
You can update the [[U-Boot_overview#bootcmd|bootcmd]] which is exectued automatically: modify '''CONFIG_EXTRA_ENV_SETTINGS''' in {{CodeSource | U-Boot | include/configs/stm32mp1.h}} and then [[U-Boot_overview#U-Boot_build|recompile U-Boot]].

For example, to boot a firmware from an SD card, proceed as follows:<pre>

#define CONFIG_EXTRA_ENV_SETTINGS \
	"stdin=serial\0" \
	"stdout=serial\0" \
	"stderr=serial\0" \
	...
	BOOTENV \
	"m4fw_name=rproc-m4-fw.elf\0" \
        "m4fw_addr=${kernel_addr_r}\0" \
	"boot_m4fw=rproc init; rproc load 0 ${m4fw_addr} ${filesize}; rproc start 0\0" \
        "boot_m4_mmc0=if ext4load mmc 0:4 ${m4fw_addr} ${m4fw_name} ; then run boot_m4fw; fi;\0"
        "bootcmd=run boot_m4_mmc0; run bootcmd_mmc0\0"</pre>


Note: It is recommended to check [[STM32MP15_U-Boot]] for compilation.

==== Start from a generic DISTRO boot script ====

Without U-boot recompilation, you can also use a DISTRO boot script '''boot.scr.uimg''' to automatically load and run the firmware.

For example, use the following script to boot from mmc 0, '''boot.scr.cmd''':

  env set m4fw_name "rproc-m4-fw.elf"
  env set m4fw_addr ${kernel_addr_r}

  #load M4 firmware
  if ext4load mmc 0:4 ${m4fw_addr} ${m4fw_name}
  then
    rproc init
    rproc load 0 ${m4fw_addr} ${filesize}
    rproc start 0
  fi

  #load kernel and device tree
  ext4load mmc 0:4 ${kernel_addr_r} uImage
  ext4load mmc 0:4 ${fdt_addr_r}  ${board_name}.dtb

  # start kernel 
  env set bootargs root=/dev/mmcblk0p6 rootwait rw console=ttySTM0,115200
  bootm ${kernel_addr_r} - ${fdt_addr_r}

Then generate the associated image using mkimage U-Boot tool:

 {{PC$}} mkimage -T script -C none -A arm -d boot.scr.cmd boot.scr.uimg

Lastly, install '''boot.scr.uimg''' in the bootfs partition (following the same procedure used for [[#Location of the coprocessor firmware|coprocessor firmware]])
 {{PC$}} sudo cp boot.scr.uimg /media/$USER/bootfs
 {{PC$}} sync

{{Warning|The 'boot.scr.uimg' U-Boot script is executed only if 'extlinux/extlinux.conf' is not found (scan_dev_for_scripts is called after scan_dev_for_extlinux)<br>You should remove pre-existing file in bootfs partition:}} 
 {{PC$}} sudo rm -r /media/$USER/bootfs/extlinux
 {{PC$}} sync

==== Start from the FIT image ====

The coprocessor firmware can also be included in the new U-Boot image format, {{CodeSource | U-Boot | doc/uImage.FIT/ |Flattened uImage Tree (FIT)}}. This firmware is then automatically loaded when it is detected by U-Boot.

{{Info|Please note that the upstreaming of this example is in progress, only a part of the files are present in the U-boot sources provided by STMicroelectronics}}

Refer to chapter 'Coprocessor firmware' in {{CodeSource | U-Boot | board/st/stm32mp1/README}}: it contains an example of '.its' file, <U-Boot directory>/board/st/stm32mp1/fit_copro_kernel_dtb.its, and shows how to generate the FIT with U-Boot mkimage tool:
 {{PC$}} mkimage -f fit_copro_kernel_dtb.its fit_copro_kernel_dtb.itb

You can load the generated FIT using:
* 'bootm' command (see {{ CodeSource | U-Boot | doc/uImage.FIT/command_syntax_extensions.txt}})
* extlinux.conf in bootfs in extlinux directory to automatically load the FIT by [[U-Boot_overview#Generic_Distro_configuration|generic DISTRO]],<br/>for example: < U-Boot directory>/board/st/stm32mp1/extlinux.conf

To go deeper, read:
* {{ CodeSource | U-Boot | doc/README.pxe }}
* {{ CodeSource | U-Boot | doc/uImage.FIT/howto.txt }}
* support of firmware in FIT is done in board_stm32copro_image_process() function in {{CodeSource | U-Boot | board/st/stm32mp1/stm32mp1.c}} associated to image type IH_TYPE_STM32COPRO.

== Synchronizing the remote firmware with Linux ==
The [[STM32MPU Embedded Software distribution]] provides the ability to detect and manage a firmware loaded by U-Boot thanks to the [[Linux_remoteproc_framework_overview#Remote_processor_.27early.27_boot | remoteproc]] Linux framework.<BR>

The developer must pay attention to how he implements the Arm Cortex-M4 firmware if the RPMsg is used to communicate with Linux. In this case a synchronization is required. The Arm Cortex-M4 core has to wait until Linux is booted to start RPMsg communications. When Linux is ready, the Linux kernel automatically updates the vdev status in the  [[Coprocessor_resource_table | resource table]], and sends a signal to the Arm Cortex-M4 core using the [[IPCC_internal_peripheral | IPCC peripheral]].<BR>

Two methods can be implemented to wait for the synchronization:
* '''Blocking method''': the firmware is blocked on MX_OPENAMP_Init  call (by the rproc_virtio_wait_remote_ready function) until the Linux kernel is ready to communicate (update of the vdev status in the resource table).
* '''Non-blocking method''': when it is ready to communicate, the Linux kernel generates an interrupt towards the Arm Cortex-M4 core using the [[IPCC_internal_peripheral | IPCC peripheral]]. This interrupt can be used by the Arm Cortex-M4 firmware to initialize the OpenAMP middleware and start the RPMsg protocol.
<noinclude>

[[Category:How to run use cases]]
[[Category:Coprocessor management STM32Cube]]
[[Category:U-Boot]]
{{PublicationRequestId | 16353| 2020-06-09 | (previous version reviewed by AlainF)}}</noinclude>
Line 4: Line 4:
 
== Introduction ==
 
== Introduction ==
 
The [[Coprocessor_management_overview|coprocessor]] firmware can be loaded and started:
 
The [[Coprocessor_management_overview|coprocessor]] firmware can be loaded and started:
* either by the second stage bootloader, U-Boot (see [[Boot_chains_overview]] for details) or
+
* either by the second stage bootloader, U-Boot (see [[Boot_chain_overview]] for details) or
 
* by the Linux<sup>&reg;</sup> kernel (see [[Linux_remoteproc_framework_overview]] for details)
 
* by the Linux<sup>&reg;</sup> kernel (see [[Linux_remoteproc_framework_overview]] for details)