What’s new in CameraX 1.4.0 and a sneak peek of Jetpack Compose assist

Posted by Scott Nien – Software program Engineer (scottnien@)

Get able to degree up your Android digicam apps! CameraX 1.4.0 simply dropped with a load of superior new options and enhancements. We’re speaking expanded HDR capabilities, preview stabilization and the versatile impact framework, and a complete lot of cool stuff to discover. We may even discover the way to seamlessly combine CameraX with Jetpack Compose! Let’s dive in and see how these enhancements can take your digicam app to the following degree.

HDR preview and Extremely HDR

Excessive Dynamic Vary (HDR) is a game-changer for pictures, capturing a wider vary of sunshine and element to create stunningly real looking photos. With CameraX 1.3.0, we introduced you HDR video recording capabilities, and now in 1.4.0, we’re taking it even additional! Prepare for HDR Preview and Extremely HDR. These thrilling additions empower you to ship a good richer visible expertise to your customers.

HDR Preview

This new function lets you allow HDR on Preview with no need to bind a VideoCapture use case. That is particularly helpful for apps that use a single preview stream for each exhibiting preview on show and video recording with an OpenGL pipeline.

To completely allow the HDR, it’s essential to guarantee your OpenGL pipeline is able to processing the precise dynamic vary format after which verify the digicam functionality.

See following code snippet for instance to allow HLG10 which is the baseline HDR normal that gadget makers should assist on cameras with 10-bit output.

// Declare your OpenGL pipeline supported dynamic vary format. 
val openGLPipelineSupportedDynamicRange = setOf(
     DynamicRange.SDR, 
     DynamicRange.HLG_10_BIT
)
// Examine digicam dynamic vary capabilities. 
val isHlg10Supported =  
     cameraProvider.getCameraInfo(cameraSelector)
           .querySupportedDynamicRanges(openGLPipelineSupportedDynamicRange)
           .comprises(DynamicRange.HLG_10_BIT)

val preview = Preview.Builder().apply {
     if (isHlg10Supported) {
        setDynamicRange(DynamicRange.HLG_10_BIT)
     }
}

Extremely HDR

Introducing Extremely HDR, a brand new format in Android 14 that lets customers seize stunningly real looking images with unimaginable dynamic vary. And one of the best half? CameraX 1.4.0 makes it extremely simple so as to add Extremely HDR seize to your app with only a few traces of code:

val cameraSelector = CameraSelector.DEFAULT_BACK_CAMERA
val cameraInfo = cameraProvider.getCameraInfo(cameraSelector)
val isUltraHdrSupported = 
      ImageCapture.getImageCaptureCapabilities(cameraInfo)
                  .supportedOutputFormats
                  .comprises(ImageCapture.OUTPUT_FORMAT_JPEG_ULTRA_HDR)

val imageCapture = ImageCapture.Builder().apply {
    if (isUltraHdrSupported) {
        setOutputFormat(ImageCapture.OUTPUT_FORMAT_JPEG_ULTRA_HDR)
    }
}.construct()

Jetpack Compose assist

Whereas this publish focuses on 1.4.0, we’re excited to announce the Jetpack Compose assist in CameraX 1.5.0 alpha. We’re including assist for a Composable Viewfinder constructed on high of AndroidExternalSurface and AndroidEmbeddedExternalSurface. The CameraXViewfinder Composable hooks up a show floor to a CameraX Preview use case, dealing with the complexities of rotation, scaling and Floor lifecycle so that you don’t have to.

// in construct.gradle 
implementation ("androidx.digicam:camera-compose:1.5.0-alpha03")


class PreviewViewModel : ViewModel() {
    personal val _surfaceRequests = MutableStateFlow<SurfaceRequest?>(null)

    val surfaceRequests: StateFlow<SurfaceRequest?>
        get() = _surfaceRequests.asStateFlow()

    personal enjoyable produceSurfaceRequests(previewUseCase: Preview) {
        // All the time publish new SurfaceRequests from Preview
        previewUseCase.setSurfaceProvider { newSurfaceRequest ->
            _surfaceRequests.worth = newSurfaceRequest
        }
    }

    // ...
}

@Composable
enjoyable MyCameraViewfinder(
    viewModel: PreviewViewModel,
    modifier: Modifier = Modifier
) {
    val currentSurfaceRequest: SurfaceRequest? by
        viewModel.surfaceRequests.collectAsState()

    currentSurfaceRequest?.let { surfaceRequest ->
        CameraXViewfinder(
            surfaceRequest = surfaceRequest,
            implementationMode = ImplementationMode.EXTERNAL, // Or EMBEDDED
            modifier = modifier        
        )
    }
}

Kotlin-friendly APIs

CameraX is getting much more Kotlin-friendly! In 1.4.0, we have launched two new droop features to streamline digicam initialization and picture seize.

// CameraX initialization 
val cameraProvider = ProcessCameraProvider.awaitInstance()

val imageProxy = imageCapture.takePicture() 
// Processing imageProxy
imageProxy.shut()

Preview Stabilization and Mirror mode

Preview Stabilization

Preview stabilization mode was added in Android 13 to allow the stabilization on all non-RAW streams, together with previews and MediaCodec enter surfaces. In comparison with the earlier video stabilization mode, which can have inconsistent FoV (Discipline of View) between the preview and recorded video, this new preview stabilization mode ensures consistency and thus offers a greater consumer expertise. For apps that report the preview straight for video recording, this mode can also be the one solution to allow stabilization.

Comply with the code under to allow preview stabilization. Please be aware that after preview stabilization is turned on, it isn’t solely utilized to the Preview but additionally to the VideoCapture whether it is certain as nicely.

val isPreviewStabilizationSupported =  
    Preview.getPreviewCapabilities(cameraProvider.getCameraInfo(cameraSelector))
        .isStabilizationSupported
val preview = Preview.Builder().apply {
    if (isPreviewStabilizationSupported) {
      setPreviewStabilizationEnabled(true)
    }
}.construct()

MirrorMode

Whereas CameraX 1.3.0 launched mirror mode for VideoCapture, we have now introduced this useful function to Preview in 1.4.0. That is particularly helpful for units with outer shows, permitting you to create a extra pure selfie expertise when utilizing the rear digicam.

To allow the mirror mode, merely name Preview.Builder.setMirrorMode APIs. This function is supported for Android 13 and above.

Actual-time Impact

CameraX 1.3.0 launched the CameraEffect framework, providing you with the facility to customise your digicam output with OpenGL. Now, in 1.4.0, we’re taking it a step additional. Along with making use of your personal customized results, now you can leverage a set of pre-built results supplied by CameraX and Media3, making it simpler than ever to reinforce your app’s digicam options.

Overlay Impact

The brand new camera-effects artifact goals to supply ready-to-use impact implementations, beginning with the OverlayEffect. This impact permits you to draw overlays on high of digicam frames utilizing the acquainted Canvas API.

The next pattern code exhibits the way to detect the QR code and draw the form of the QR code as soon as it’s detected.

By default, drawing is carried out in floor body coordinates. However what if it’s essential to use digicam sensor coordinates? No drawback! OverlayEffect offers the Body#getSensorToBufferTransform operate, permitting you to use the required transformation matrix to your overlayCanvas.

On this instance, we use CameraX’s MLKit Imaginative and prescient APIs (MlKitAnalyzer) and specify COORDINATE_SYSTEM_SENSOR to acquire QR code nook factors in sensor coordinates. This ensures correct overlay placement no matter gadget orientation or display screen side ratio.

// in construct.gradle 
implementation ("androidx.digicam:camera-effects:1.4.1}")      
implementation ("androidx.digicam:camera-mlkit-vision:1.4.1")

var qrcodePoints: Array<Level>? = null
var qrcodeTimestamp = 0L
val qrcodeBoxEffect 
    = OverlayEffect(
        PREVIEW /* utilized on the preview solely */,
        5, /* maintain a number of frames within the queue so we will match evaluation consequence 
              with preview body */, 
        Handler(Looper.getMainLooper()), {}
      )

enjoyable initCamera() {
    qrcodeBoxEffect.setOnDrawListener { body ->
        if(body.timestamp != qrcodeTimestamp) {
            // Don't change the drawing if the body doesn’t match the evaluation 
            // consequence.
            return@setOnDrawListener true
        }
        body.overlayCanvas.drawColor(Shade.TRANSPARENT, PorterDuff.Mode.CLEAR)
        qrcodePoints?.let {
            // Utilizing sensor coordinates to attract.
            body.overlayCanvas.setMatrix(body.sensorToBufferTransform)
            val path = android.graphics.Path().apply {
                it.forEachIndexed { index, level ->
                    if (index == 0) {
                        moveTo(level.x.toFloat(), level.y.toFloat())
                    } else {
                        lineTo(level.x.toFloat(), level.y.toFloat())
                    }
                 }
                 lineTo(it[0].x.toFloat(), it[0].y.toFloat())
            }
            body.overlayCanvas.drawPath(path, paint)
        }
        true
    }

    val imageAnalysis = ImageAnalysis.Builder()
        .construct()
        .apply {
            setAnalyzer(executor,
                MlKitAnalyzer(
                    listOf(barcodeScanner!!),
                    COORDINATE_SYSTEM_SENSOR,
                    executor
                ) { consequence ->
                    val barcodes = consequence.getValue(barcodeScanner!!)
                    qrcodePoints = 
                        barcodes?.takeIf { it.measurement > 0}?.get(0)?.cornerPoints
                    // monitor the timestamp of the evaluation consequence and launch the 
                    // preview body.
                    qrcodeTimestamp = consequence.timestamp
                    qrcodeBoxEffect.drawFrameAsync(qrcodeTimestamp)
                }
            )
        }

    val useCaseGroup = UseCaseGroup.Builder()
          .addUseCase(preview)
          .addUseCase(imageAnalysis)
          .addEffect(qrcodeBoxEffect)
          .construct()

    cameraProvider.bindToLifecycle(
        lifecycleOwner, cameraSelector, usecaseGroup)
  }

Here’s what the impact appears to be like like:

Display screen Flash

Taking selfies in low mild simply received simpler with CameraX 1.4.0! This launch introduces a robust new function: display screen flash. As an alternative of counting on a conventional LED flash which most selfie cameras don’t have, display screen flash cleverly makes use of your telephone’s show. By momentarily turning the display screen vibrant white, it offers a burst of illumination that helps seize clear and vibrant selfies even in difficult lighting circumstances.

Integrating display screen flash into your CameraX app is versatile and easy. You will have two primary choices:

1. Implement the ScreenFlash interface: This offers you full management over the display screen flash habits. You’ll be able to customise the colour, depth, length, and another side of the flash. That is superb when you want a extremely tailor-made resolution.

2. Use the built-in implementation: For a fast and straightforward resolution, leverage the pre-built display screen flash performance in ScreenFlashView or PreviewView. This implementation handles all of the heavy lifting for you.

In the event you’re already utilizing PreviewView in your app, enabling display screen flash is extremely easy. Simply allow it straight on the PreviewView occasion. In the event you want extra management or aren’t utilizing PreviewView, you need to use ScreenFlashView straight.

This is a code instance demonstrating the way to allow display screen flash:

// case 1: PreviewView + CameraX core API.
previewView.setScreenFlashWindow(exercise.getWindow());
imageCapture.screenFlash = previewView.screenFlash
imageCapture.setFlashMode(ImageCapture.FLASH_MODE_SCREEN)

// case 2: PreviewView + CameraController
previewView.setScreenFlashWindow(exercise.getWindow());
cameraController.setImageCaptureFlashMode(ImageCapture.FLASH_MODE_SCREEN);

// case 3 : use ScreenFlashView 
screenFlashView.setScreenFlashWindow(exercise.getWindow());
imageCapture.setScreenFlash(screenFlashView.getScreenFlash());
imageCapture.setFlashMode(ImageCapture.FLASH_MODE_SCREEN);

Digital camera Extensions new options

Digital camera Extensions APIs intention to assist apps to entry the cutting-edge capabilities beforehand out there solely on built-in digicam apps. And the ecosystem is rising quickly! In 2024, we have seen main gamers like Pixel, Samsung, Xiaomi, Oppo, OnePlus, Vivo, and Honor all embrace Digital camera Extensions, significantly for Evening Mode and Bokeh Mode. CameraX 1.4.0 takes this even additional by including assist for brand-new Android 15 Digital camera Extensions options, together with:

• Postview: Supplies a preview of the captured picture nearly immediately earlier than the long-exposure pictures are accomplished
• Seize Course of Progress: Shows a progress indicator so customers know the way lengthy capturing and processing will take, bettering the expertise for options like Evening Mode
• Extensions Energy: Permits customers to fine-tune the depth of the utilized impact

Beneath is an instance of the improved UX that makes use of postview and seize course of progress options on Samsung S24 Extremely.

to know the way this may be carried out? See the pattern code under:

val extensionsCameraSelector =  
    extensionsManager
        .getExtensionEnabledCameraSelector(DEFAULT_BACK_CAMERA, extensionMode)
val isPostviewSupported = ImageCapture.getImageCaptureCapabilities(                   
    cameraProvider.getCameraInfo(extensionsCameraSelector)
).isPostviewSupported
val imageCapture = ImageCapture.Builder().apply {
    setPostviewEnabled(isPostviewSupported)
}.construct()

imageCapture.takePicture(outputfileOptions, executor,  
    object : OnImageSavedCallback {
        override enjoyable onImageSaved(outputFileResults: OutputFileResults) {
            // closing picture saved. 
        }
        override enjoyable onPostviewBitmapAvailable(bitmap: Bitmap) {
            // Postview bitmap is obtainable.
        }
        override enjoyable onCaptureProcessProgressed(progress: Int) {
            // seize course of progress replace 
        }
}

Necessary: In case your app bumped into the CameraX Extensions situation on Pixel 9 sequence units, please use CameraX 1.4.1 as a substitute. This launch fixes a crucial situation that prevented Evening Mode from working accurately with takePicture.

What’s Subsequent

We hope you take pleasure in this new launch. Our mission is to make digicam growth a pleasure, eradicating the friction and ache factors so you’ll be able to concentrate on innovation. With CameraX, you’ll be able to simply harness the facility of Android’s digicam capabilities and construct actually superb app experiences.

Have questions or need to join with the CameraX staff? Be part of the CameraX developer dialogue group or file a bug report:

We are able to’t wait to see what you create!