Skip to main content

2. DVP Use

2.1. Board Resource​

There is a DVP camera interface on the Firefly-RK3288-Reload development board. This article will introduce how to make the camera work properly, using OV5640 as an example.

2.2. Relevant Code Directory​

The code directories of camera are shown as followed:

Android：

`- hardware/rockchip/camera
  |- Config
  |  `- cam_board.xml		# Parameter Configuration
  |- CameraHal				# HAL source code
  `- SiliconImage			# ISP library, including driver source code of all supported modules.
     `- isi/drv/OV5640		# Driver source code of OV5640 module.
        `- calib/OV5640.xml # Calibration parameter of OV5640 module.

Kernel：

|- kernel/drivers/media/video/rk_camsys  // CamSys driver source code
`- kernel/include/media/camsys_head.h

2.3. Configuration Theory​

What you need to configure the camera is to make the pins and clock work properly.

According to the schematic diagram below, you need to provide: VCC28_DVP、VCC18_DVP、VCCIO_YUV、PWDN(FLASH0_CLE)、RESET and XCLK1.

_images/dvp_interface.png _images/dvp_power_1.png

  • RST controled by PDN1 _images/dvp_power_2.png
  • PWDN、RST are connected to GPIO3_B4、GPIO2_B7 _images/dvp_power_3.png

2.3.1. Android Layer Configuration​

Edit hardware/rockchip/camera/Config/cam_board_rk3288.xml to configure the camera:

<?xml version="1.0" ?>
<BoardFile>
  <BoardXmlVersion version="v0.0xd.0"></BoardXmlVersion>
    <CamDevie>
        <HardWareInfo>
            <Sensor>
                <SensorName name="OV5640" ></SensorName>
                <SensorDevID IDname="CAMSYS_DEVID_SENSOR_2"></SensorDevID>
                <SensorHostDevID busnum="CAMSYS_DEVID_MARVIN" ></SensorHostDevID>
                <SensorI2cBusNum busnum="3"></SensorI2cBusNum>
                <SensorI2cAddrByte byte="2"></SensorI2cAddrByte>
                <SensorI2cRate rate="100000"></SensorI2cRate>
                <SensorMclk mclk="24000000"></SensorMclk>
                <SensorAvdd name="NC" min="0" max="0"></SensorAvdd>
                <SensorDovdd name="NC" min="18000000" max="18000000"></SensorDovdd>
                <SensorDvdd name="NC" min="0" max="0"></SensorDvdd>
                <SensorGpioPwdn ioname="RK30_PIN3_PB4" active="1"></SensorGpioPwdn>
                <SensorGpioRst ioname="RK30_PIN2_PB7" active="0"></SensorGpioRst>
                <SensorGpioPwen ioname="RK30_PIN0_PB3" active="1"></SensorGpioPwen>
                <SensorFacing facing="front"></SensorFacing>
                <SensorInterface mode="CCIR601"></SensorInterface>
                <SensorMirrorFlip mirror="0"></SensorMirrorFlip>
                <SensorOrientation orientation="0"></SensorOrientation>
                <SensorPowerupSequence seq="1234">
                <SensorFovParemeter h="60.0" v="60.0"></SensorFovParemeter>
                <SensorAWB_Frame_Skip fps="15"></SensorAWB_Frame_Skip>
                <SensorPhy phyMode="CamSys_Phy_Cif" sensor_d0_to_cif_d="0" cif_num="0" sensorFmt="CamSys_Fmt_Raw_10b"></SensorPhy>
             </Sensor>
             <VCM>
                <VCMDrvName name="NC"></VCMDrvName>
                <VCMName name="NC"></VCMName>
                <VCMI2cBusNum busnum="0"></VCMI2cBusNum>
                <VCMI2cAddrByte byte="0"></VCMI2cAddrByte>
                <VCMI2cRate rate="0"></VCMI2cRate>
                <VCMVdd name="NC" min="0" max="0"></VCMVdd>
                <VCMGpioPwdn ioname="NC" active="0"></VCMGpioPwdn>
                <VCMGpioPower ioname="NC" active="0"></VCMGpioPower>
                <VCMCurrent start="20" rated="80" vcmmax="100" stepmode="13"  drivermax="100"></VCMCurrent>
            </VCM>
            <Flash>
                <FlashName name="NC"></FlashName>
                <FlashI2cBusNum busnum="0"></FlashI2cBusNum>
                <FlashI2cAddrByte byte="0"></FlashI2cAddrByte>
                <FlashI2cRate rate="0"></FlashI2cRate>
                <FlashTrigger ioname="NC" active="1"></FlashTrigger>
                <FlashEn ioname="NC" active="1"></FlashEn>
                <FlashModeType mode="0"></FlashModeType>
                <FlashLuminance luminance="0"></FlashLuminance>
                <FlashColorTemp colortemp="0"></FlashColorTemp>
            </Flash>
    </HardWareInfo>
        <SoftWareInfo>
            <AWB>
                <AWB_Auto support="1"></AWB_Auto>
                <AWB_Incandescent support="1"></AWB_Incandescent>
                <AWB_Fluorescent support="1"></AWB_Fluorescent>
                <AWB_Warm_Fluorescent support="1"></AWB_Warm_Fluorescent>
                <AWB_Daylight support="1"></AWB_Daylight>
                <AWB_Cloudy_Daylight support="1"></AWB_Cloudy_Daylight>
                <AWB_Twilight support="1"></AWB_Twilight>
                <AWB_Shade support="1"></AWB_Shade>
            </AWB>
            <Sence>
                <Sence_Mode_Auto support="1"></Sence_Mode_Auto>
                <Sence_Mode_Action support="1"></Sence_Mode_Action>
                <Sence_Mode_Portrait support="1"></Sence_Mode_Portrait>
                <Sence_Mode_Landscape support="1"></Sence_Mode_Landscape>
                <Sence_Mode_Night support="1"></Sence_Mode_Night>
                <Sence_Mode_Night_Portrait support="1"></Sence_Mode_Night_Portrait>
                <Sence_Mode_Theatre support="1"></Sence_Mode_Theatre>
                <Sence_Mode_Beach support="1"></Sence_Mode_Beach>
                <Sence_Mode_Snow support="1"></Sence_Mode_Snow>
                <Sence_Mode_Sunset support="1"></Sence_Mode_Sunset>
                <Sence_Mode_Steayphoto support="1"></Sence_Mode_Steayphoto>
                <Sence_Mode_Pireworks support="1"></Sence_Mode_Pireworks>
                <Sence_Mode_Sports support="1"></Sence_Mode_Sports>
                <Sence_Mode_Party support="1"></Sence_Mode_Party>
                <Sence_Mode_Candlelight support="1"></Sence_Mode_Candlelight>
                <Sence_Mode_Barcode support="1"></Sence_Mode_Barcode>
                <Sence_Mode_HDR support="1"></Sence_Mode_HDR>
            </Sence>
            <Effect>
                <Effect_None support="1"></Effect_None>
                <Effect_Mono support="1"></Effect_Mono>
                <Effect_Solarize support="1"></Effect_Solarize>
                <Effect_Negative support="1"></Effect_Negative>
                <Effect_Sepia support="1"></Effect_Sepia>
                <Effect_Posterize support="1"></Effect_Posterize>
                <Effect_Whiteboard support="1"></Effect_Whiteboard>
                <Effect_Blackboard support="1"></Effect_Blackboard>
                <Effect_Aqua support="1"></Effect_Aqua>
            </Effect>
            <FocusMode>
                <Focus_Mode_Auto support="0"></Focus_Mode_Auto>
                <Focus_Mode_Infinity support="0"></Focus_Mode_Infinity>
                <Focus_Mode_Marco support="0"></Focus_Mode_Marco>
                <Focus_Mode_Fixed support="0"></Focus_Mode_Fixed>
                <Focus_Mode_Edof support="0"></Focus_Mode_Edof>
                <Focus_Mode_Continuous_Video support="0"></Focus_Mode_Continuous_Video>
                <Focus_Mode_Continuous_Picture support="0"></Focus_Mode_Continuous_Picture>
             </FocusMode>
            <FlashMode>
                <Flash_Mode_Off support="1"></Flash_Mode_Off>
                <Flash_Mode_On support="1"></Flash_Mode_On>
                <Flash_Mode_Torch support="1"></Flash_Mode_Torch>
                <Flash_Mode_Auto support="1"></Flash_Mode_Auto>
                <Flash_Mode_Red_Eye support="1"></Flash_Mode_Red_Eye>
            </FlashMode>
            <AntiBanding>
                <Anti_Banding_Auto support="1"></Anti_Banding_Auto>
                <Anti_Banding_50HZ support="1"></Anti_Banding_50HZ>
                <Anti_Banding_60HZ support="1"></Anti_Banding_60HZ>
                <Anti_Banding_Off support="1"></Anti_Banding_Off>
            </AntiBanding>
            <HDR support="1"></HDR>
            <ZSL support="1"></ZSL>
            <DigitalZoom support="1"></DigitalZoom>
            <Continue_SnapShot support="1"></Continue_SnapShot>
            <PreviewSize width="800" height="600"></PreviewSize>
            <DV>
                <DV_QCIF name="qcif" width="176" height="144" fps="10" support="1"></DV_QCIF>
                <DV_QVGA name="qvga" width="320" height="240" fps="10" support="1"></DV_QVGA>
                <DV_CIF name="cif" width="352" height="288" fps="10" support="1"></DV_CIF>
                <DV_VGA name="480p" width="640" height="480" fps="10" support="1"></DV_VGA>
                <DV_480P name="480p" width="720" height="480" fps="10" support="0"></DV_480P>
                <DV_720P name="720p" width="1280" height="720" fps="10" support="0"></DV_720P>
                <DV_1080P name="1080p" width="1920" height="1080" fps="10" support="0"></DV_1080P>
            </DV>
        </SoftWareInfo>
    </CamDevie>
</BoardFile>

You can modify these contents:

  • Sensor Name
<SensorName name="OV5640" ></SensorName>

This name must match the name of the sensor driver, which has the following format: libisp_isi_drv_OV5640.so

This driver file will be created in directory “ out/target/product/rk3288_box/system/lib/hw/” after an Android build.

  • Sensor Software ID
<SensorDevID IDname="CAMSYS_DEVID_SENSOR_2">

The ID must be unique among the camera drivers.You can fill with the following values:

CAMSYS_DEVID_SENSOR_1A
CAMSYS_DEVID_SENSOR_1B
CAMSYS_DEVID_SENSOR_2
  • Collector Name
<SensorHostDevID busnum="CAMSYS_DEVID_MARVIN" ></SensorHostDevID>

Currently only support:

CAMSYS_DEVID_MARVIN
  • I2C channel number
<SensorI2cBusNum busnum="3"></SensorI2cBusNum>

You can get the number via schematic or datasheet of RK3288.

  • Length of Register Address (in bytes)
<SensorI2cAddrByte byte="2"></SensorI2cAddrByte>
  • Clock of I2C (in Hz)
<SensorI2cRate rate="100000"></SensorI2cRate>
  • MCLK of Camera (in Hz)
<SensorMclk mclk="24000000"></SensorMclk>
  • PMU LDO Name Connected to AVDD. Set to NC if not connected.
<SensorAvdd name="NC" min="0" max="0"></SensorAvdd>
  • PMU LDO Name Connected to DOVDD
<SensorDovdd name="NC" min="18000000" max="18000000"></SensorDovdd>

Set to NC if not connected to PMU. Value of min and max must be specified, which determinte the voltage of the IO pins.

  • PMU LDO Name Connected to DVDD
<SensorDvdd name="NC" min="0" max="0"></SensorDvdd>

Set to NC if not connected to PMU.

  • PowerDown Pin
<SensorGpioPwdn ioname="RK30_PIN3_PB4" active="1"></SensorGpioPwdn>

Fill in the GPIO’s name and active level.

  • Reset Pin
<SensorGpioRst ioname="RK30_PIN2_PB7" active="0"></SensorGpioRst>

Fill in the GPIO’s name and active level.

  • Power Pin
<SensorGpioPwen ioname="RK30_PIN0_PB3" active="1"></SensorGpioPwen>

Fill in the GPIO’s name and active level.

  • Facing Value
<SensorFacing facing="front"></SensorFacing>

Set the value as “front” or “back”.

  • Camera Interface Type
<SensorInterface mode="MIPI"></SensorInterface>

The following values are valid:

CCIR601
CCIR656
MIPI
SMIA
  • Mirror Flip
<SensorMirrorFlip mirror="0"></SensorMirrorFlip>

This is not supported at the moment.

  • Orientation
<SensorOrientation orientation="0"></SensorOrientation>

  • Hardware Interface

    • DVP
<SensorPhy phyMode="CamSys_Phy_Cif" sensor_d0_to_cif_d ="0" cif_num="0" sensorFmt="CamSys_Fmt_Raw_10b"></SensorPhy>
  1. phyMode: Sensor hardware interface type, set to “CamSys_Phy_Cif” if it is a DVP sensor.
  2. sensor_d0_to_cif_d: The data number of the SoC DVP interface, which is connected with output data D0 of sensor DVP.
  3. cif_num: The interface number of the SoC DVP, which is connected with sensor DVP.
  4. sensorFmt：Data format of sensor output. Only “CamSys_Fmt_Raw_10b” is supported.

2.3.2. Compile Kernel​

Build “drivers\media\video\rk_camsys” driver into kernel, with following configuration instructions:

Run in the kernel source directory:

make menuconfig

Select the following configuration items:

Device Drivers  --->
<*>Multimedia support  --->
        <*>camsys driver
         RockChip camera system driver  --->
                  <*> camsys driver for marvin isp
                  < > camsys driver for cif

Finally, run:

make firefly-rk3288-reload.img

which will start the kernel compilation.