搜索的稳定性和可扩展性
The Search Infrastructure team’s goal is to provide a low-friction, self-service platform that simplifies and accelerates the end-to-end journey of creating and iterating on a search experience.
搜索基础设施团队的目标是提供一个低摩擦的自助服务平台,简化并加速创建和迭代搜索体验的端到端旅程。
We power real-time search for Tweets, Users, Direct Messages and more! As a platform team, operating at Twitter scale, it is crucial to offer a high level of stability and performance to our customers. To accomplish this, for a portion of our use cases, we use Open Distro for Elasticsearch. This blog will explain the work we have done, in addition to what Elasticsearch provides, to make sure our product teams at Twitter can scale quickly and efficiently for our customers. To improve the search experience at Twitter, we added a proxy to Elasticsearch, and created an Ingestion Service and Backfill Service.
我们为推文、用户、直接信息等的实时搜索提供动力作为一个平台团队,在Twitter的规模下运作,为我们的客户提供高水平的稳定性和性能是至关重要的。为了实现这一目标,在我们的部分用例中,我们使用Open Distro for Elasticsearch。这篇博客将解释我们所做的工作,除了Elasticsearch所提供的,以确保我们在Twitter的产品团队能够为我们的客户快速有效地扩展。为了改善Twitter的搜索体验,我们为Elasticsearch添加了一个代理,并创建了一个Ingestion Service和Backfill Service。
Elasticsearch at Twitter
Elasticsearch在Twitter
Elasticsearch is a search engine based on the Lucene library. It is a popular open source tool widely used in industry and is known for its distributed nature, speed, scalability, and simple REST APIs.
Elasticsearch是一个基于Lucene库的搜索引擎。它是一个流行的开源工具,在行业中广泛使用,并以其分布式性质、速度、可扩展性和简单的REST API而闻名。
The Search Infrastructure team builds infrastructure to host search as a service. Since we are such a central infrastructure team, we need to maintain a high level of stability and performance for our customers. Our team exposes all Elasticsearch APIs because they are powerful, flexible, and well-documented. We then provide plugins and tooling to ensure compliance and easy integration with Twitter services.
搜索基础设施团队建立了基础设施,以托管搜索作为一项服务。由于我们是这样一个核心的基础设施团队,我们需要为我们的客户保持高水平的稳定性和性能。我们的团队公开了所有Elasticsearch的API,因为它们是强大的、灵活的,并且有良好的文档。然后,我们提供插件和工具,以确保与Twitter服务的合规性和轻松整合。