AI at the Core of Credera: Building CrederaGPT

At Credera, we're at the forefront of technological innovation, constantly exploring and integrating cutting-edge technologies to provide our clients with market-leading solutions. Our commitment to innovation drives us to engage deeply with new technologies, contribute to open-source projects, and foster a culture of continuous research and experimentation.

One of the most exciting recent developments has been the emergence of advanced artificial intelligence (AI) technologies like ChatGPT and other large language models (LLMs). These innovations have opened up unprecedented opportunities for us to develop our own comprehensive, plug-and-play AI platform we’re calling CrederaGPT. This platform is now globally available across Credera, offering a range of AI functionalities within a secure and compliant framework.

Here’s a brief history of how we built CrederaGPT and how we’re putting AI at the core of what we do.

From experimentation to enterprise solutions

Our journey with generative AI began with building proof-of-concept projects to showcase the potential of these technologies. We utilized tools such as Python, LlamaIndex, StreamLit, React, and LangChain, deploying various foundational models both internally and externally. These initial projects were instrumental in helping our clients enhance and optimize their processes.

Recognizing the need for a more robust solution as we transitioned to production environments, we focused on creating a unified platform. This platform addresses such key concerns as security, performance, resiliency, and multitenancy—all crucial for enterprise-grade deployments. By centralizing these core services, we've not only reduced redundancy but also increased our agility and pace of innovation.

Our technological foundation

The backbone of our platform comprises several key technologies that ensure security, efficiency, and scalability:

• DevContainers and GitHub CodeSpaces: Provide reproducible development environments.

• GitHub Actions: Streamline automated deployments.

• PostgreSQL with pgvector: Offer scalable vector storage and search capabilities.

• Rust and Axum: Deliver safe, performant REST microservices.

• Leptos and WebAssembly: Create a responsive and efficient front end, enhanced by HTMX.

• Okta: Facilitate authentication and single sign-on (SSO).

• JWT for Zero Trust: Secure inter-component communications.

• Apache APIsix: Centralize API management.

• OpenFGA by CNCF: Implement fine-grained authorization based on Google Zanzibar's scalable architecture.

• Private OpenAI Instance in Azure: Ensure secure AI deployment.

• AWS-based Enterprise Kubernetes Environment: Support scalable and reliable operations.

This comprehensive setup has empowered us to create a secure, multitenant microservice architecture that meets both our functional and non-functional requirements. It supports agile delivery and rapid development, allowing multiple deployments per day.

Looking to the future with WebAssembly

As we continue to innovate, we're exploring the use of WebAssembly (WASM) for server-side deployments. Traditionally a client-side technology, WASM is gaining traction for server-side applications, offering a secure and efficient alternative to traditional plugin functionalities. By integrating WASM, we aim to provide our clients with the flexibility to extend our platform using their preferred languages, such as Rust, Go, C, Kotlin, and AssemblyScript.

This approach will enable us to deliver a wider range of generative AI use cases, supporting a diverse array of internal tools and client-facing solutions. As the technologies mature, we believe our work will position us as a key partner for organizations navigating the complexities of digital transformation.

Join us in solving the hard problems

At Credera, we thrive on tackling challenging problems with innovative solutions. Our work with cutting-edge technologies like AI and WebAssembly is just one example of how we're pushing the boundaries of what's possible. If you're facing a complex challenge or are interested in learning more about our approach, we'd love to connect.

Get in touch with us today to explore how we can help you navigate the future of technology.

• Generative AI
• AI Technology
• AI Strategy
• AI