F5 and Intel companion to boost AI safety and efficiency

F5 has introduced it’s bringing strong software safety and supply capabilities to AI deployments powered by Intel. This joint answer combines safety and visitors administration from F5’s NGINX Plus providing with the cutting-edge optimisation and efficiency of the Intel Distribution of OpenVINO toolkit and infrastructure processing items (IPUs) to ship safety, scalability and efficiency for AI inference.

As organisations more and more undertake AI to energy clever functions and workflows, environment friendly and safe AI inference turns into crucial. This want is addressed by combining the OpenVINO toolkit — which optimises and accelerates AI mannequin inference — with F5 NGINX Plus, offering strong visitors administration and safety.

The OpenVINO toolkit simplifies the optimisation of fashions from nearly any framework to allow a write-once, deploy-anywhere method. This toolkit is important for builders aiming to create scalable and environment friendly AI options with minimal code modifications.

F5 NGINX Plus enhances the safety and reliability of those AI fashions. Performing as a reverse proxy, NGINX Plus manages visitors, ensures excessive availability and supplies lively well being checks. It additionally facilitates SSL termination and mTLS encryption, safeguarding communications between functions and AI fashions with out compromising efficiency.

To additional enhance efficiency, Intel IPUs offload infrastructure providers from the host CPU, releasing up assets for AI mannequin servers. The IPUs effectively handle infrastructure duties, opening up assets to boost the scalability and efficiency of each NGINX Plus and OpenVINO Mannequin Servers (OVMS).

This built-in answer is useful for edge functions, corresponding to video analytics and IoT, the place low latency and excessive efficiency are essential. By operating NGINX Plus on the Intel IPU, the answer helps guarantee dependable responses, making it an optimum selection for content material supply networks and distributed microservices deployments.

“Teaming up with Intel empowers us to push the boundaries of AI deployment. This collaboration highlights our dedication to driving innovation and delivers a safe, dependable and scalable AI inference answer that can allow enterprises to securely ship AI providers at pace. Our mixed answer ensures that organizations can harness the ability of AI with superior efficiency and safety,” mentioned Kunal Anand, the chief expertise officer at F5.

“Utilizing the cutting-edge infrastructure acceleration of Intel IPUs and the OpenVINO toolkit alongside F5 NGINX Plus can assist allow enterprises to grasp revolutionary AI inference options with improved simplicity, safety and efficiency at scale for a number of vertical markets and workloads,” mentioned Pere Monclus, chief expertise officer, community and edge group of Intel.

The answer is now accessible. For extra info, go to f5.com/intel. As well as, a companion weblog from F5 CTO Kunal Anand supplies additional perception on this providing.