This week in Databend #25

Databend[1] aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

•support [NOT] IN (a, b, c, ...) InList SQL by @Veeupup[2] (#3805[3])

Improvement

•range filter support more multi-column expression scenarios by @zhyass[4]. (#3851[5]•refine the error code by @BohuTANG[6]. (#3833[7])•lower the memory usage of BlockStreamWriter by @dantengsky[8]. (#3818[9])•manage role storage in metasrv by @flaneur2020[10]. (#3878[11])

Build/Test/CI

•introduce databend Dev container by @ZhiHanZ[12]. (#3853[13])•use peotry to manage all python packages by @Xuanwo[14]. (#3902[15])

Bug fixes

•fix bug that list_databases return all tenants' databases by @ariesdevil[16]. (#3876[17])•optimize table cause of meta data damage by @dantengsky[18]. (#3873[19])•fix MySQL 8.0 JDBC compatibility error by @TCeason[20]. (#3852[21])

Experimental

•add datavalues2 by @sundy-li[22]. (#3857[23]).

A series of refactorings will be carried out at datavalues-dev[24] branch to complete the migration. See RFC - new datavalues system design[25].

Tips

Let's learn a weekly tip from Databend.

Build/Test Databend with Dev container

In #3853[26] , we have introduced a development container to make it easy for contributors to build and test Databend.

build binary artifacts

./scripts/setup/run_docker.sh  make build

run test

./scripts/setup/run_docker.sh  make test

debug or get into dev container

./scripts/setup/run_docker.sh /bin/bash

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

•v0.6.38-nightly[27]•v0.6.37-nightly[28]•v0.6.36-nightly[29]•v0.6.35-nightly[30]•v0.6.34-nightly[31]•v0.6.33-nightly[32]

Ecosystem/Upstream

From open source, for open source. Our team is also committed to contributing to the Rust ecosystem and upstream dependencies.

•A ton of updates to openraft[33]. by @drmingdrmer[34] & @lichuang[35]•release naive-cityhash v0.2.0[36]: add basic 64 bit cityhash support. by @PsiACE[37]

Meet Us

Please join the DatafuseLabs Community[38] if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues[39] for any problems you find. We also highly appreciate any of your pull requests.

•Databend Website[40]•Twitter[41]•GitHub Discussions[42]•Slack Channel[43]

引用链接

[1] Databend: https://github.com/datafuselabs/databend
[2] @Veeupup: https://github.com/Veeupup
[3] #3805: https://github.com/datafuselabs/databend/pull/3805
[4] @zhyass: https://github.com/zhyass
[5] #3851: https://github.com/datafuselabs/databend/pull/3851
[6] @BohuTANG: https://github.com/BohuTANG
[7] #3833: https://github.com/datafuselabs/databend/pull/3833
[8] @dantengsky: https://github.com/dantengsky
[9] #3818: https://github.com/datafuselabs/databend/pull/3818
[10] @flaneur2020: https://github.com/flaneur2020
[11] #3878: https://github.com/datafuselabs/databend/pull/3878
[12] @ZhiHanZ: https://github.com/ZhiHanZ
[13] #3853: https://github.com/datafuselabs/datafuse/pull/3853
[14] @Xuanwo: https://github.com/Xuanwo
[15] #3902: https://github.com/datafuselabs/datafuse/pull/3902
[16] @ariesdevil: https://github.com/ariesdevil/
[17] #3876: https://github.com/datafuselabs/databend/pull/3876
[18] @dantengsky: https://github.com/dantengsky
[19] #3873: https://github.com/datafuselabs/databend/pull/3873
[20] @TCeason: https://github.com/TCeason
[21] #3852: https://github.com/datafuselabs/databend/pull/3852
[22] @sundy-li: https://github.com/sundy-li
[23] #3857: https://github.com/datafuselabs/databend/pull/3857
[24] datavalues-dev: https://github.com/datafuselabs/databend/tree/datavalues-dev
[25] RFC - new datavalues system design: https://databend.rs/dev/rfcs/query/new-datavalues-system
[26] #3853: https://github.com/datafuselabs/datafuse/pull/3853
[27] v0.6.38-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.38-nightly
[28] v0.6.37-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.37-nightly
[29] v0.6.36-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.36-nightly
[30] v0.6.35-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.35-nightly
[31] v0.6.34-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.34-nightly
[32] v0.6.33-nightly: https://github.com/datafuselabs/databend/releases/tag/v0.6.33-nightly
[33] A ton of updates to openraft: https://github.com/datafuselabs/openraft/pulse#merged-pull-requests
[34] @drmingdrmer: https://github.com/drmingdrmer
[35] @lichuang: https://github.com/lichuang
[36] release naive-cityhash v0.2.0: https://crates.io/crates/naive-cityhash/0.2.0
[37] @PsiACE: https://github.com/PsiACE/
[38] DatafuseLabs Community: https://github.com/datafuselabs/
[39] issues: https://github.com/datafuselabs/databend/issues
[40] Databend Website: https://databend.rs
[41] Twitter: https://twitter.com/Datafuse_Labs
[42] GitHub Discussions: https://github.com/datafuselabs/databend/discussions
[43] Slack Channel: https://datafusecloud.slack.com/join/shared_invite/zt-nojrc9up-50IRla1Y1h56rqwCTkkDJA

Comments

Post a Comment

Popular posts from this blog

The Databend Community Actively Embraces The Rust Ecosystem

Image
The Databend Community Actively Embraces The Rust Ecosystem Databend aims to become an open source, flexible, and reliable serverless data warehouse, it can query fast as lightning, and organically combined with flexible, simple, and low-cost cloud services. The construction of data cloud has never been easier! What Databend Means to The Rust Community Most Databend's team members have rich experience in database/data platform development and open source collaboration. So we choose Rust to develop the next-generation data cloud services which can performance higher performance and more reliable. 1.  Create the top seed player in the Rust data warehouse field, show the charm of Rust, and promote the further application of Rust in the database field. 2.  Continue to promote Rust's efforts in data governance/database/cloud native and other domains to improve the ecosystem and tools. 3.  Provide more learning/practice/job opportunities for Rustacean, and cultivate a group of ...
Read more

This week in Databend #26

[Databend](https://github.com/datafuselabs/databend) aimed to be an open source **elastic** and **reliable** cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy. ## Big changes Below is a list of some major changes that we don't want you to miss. ### Features - **add bloom filter for single column equivalent expression** by [@junli1026](https://github.com/junli1026) ([#3887](https://github.com/datafuselabs/databend/pull/3887)) - **Jwt Auth for http handler** by [@youngsofun](https://github.com/youngsofun) ([#3993](https://github.com/datafuselabs/databend/pull/3993)) ## Improvement - **add partitions_scanned and partitions_total to planner statistics** by [@BohuTANG](https://github.com/BohuTANG). ([#3909](https://github.com/datafuselabs/databend/pull/3909)) - **clean up metasrv code and test** by [@drmingdrmer](https://github.com/drmingdrmer). ([#3925](https://github.com/datafuselabs/databend/pul...
Read more

Databend Design | Whitepapers

Image
Databend is an open source   elastic   and   scalable   cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy. Databend is intended for executing workloads with data stored in cloud storage systems, such as AWS S3 and Azure Blob Storage or others. We design Databend with the following key functionalities in mind: Elastic  In Databend storage and compute resources can dynamically scale up and down on demand. Secure  All data files and network traffic in Databend is encrypted end-to-end, and provider  Role Based Access Control  in SQL level. User-friendly  Databend is an ANSI SQL compliant cloud warehouse, it is easy for data scientist and engineers to use. Cost-efficient  Databend processes queries with high performance, and the user only pays for what is actually used. The picture above shows the high-level architecture of Databend, it consists of three...
Read more