POHMELFS: Happy New Year and Merry Christmas
Hi
I know, most of you asked Santa Claus for new distributed filesystem. So instead of increasing entropy and size of the kernel Sata brings you old but completely redesigned distributed filesystem.
Pohmelfs moved away from old and basically non-working design of parallel NFS to real-life working distributed storage named elliptics [1]
It implements key-value storage which by default works as DHT. As every distributed system it has replicas, automatic recovery, integrity checksums, no single-points-of-failure aka master server/name node and so on, solumn data store, automatic repartitioning on new servers, compression support, server-side scripting and so on Server-side scripting allows to perform arbitrary actions on provided data, for example pohmelfs directory support implemented that way - all transactions in elliptics are atomic (on single replica) by default, so server-side may read data, update it the way it likes and push it back into the storage.
Elliptics is used in production about 2 years now and hosts clusters from several billions of small objects (Yandex.Maps/partially Yandex.Photos) to 1 Pb storage (Yandex.Music)
Main goal of this storage is ability to work with multiple datacenters out of the box (replication unit aka group fits quite well into single datacenter abstraction) and is aimed at high IO operations per second workload type instead of boring bulk MB/s IOs in 21 century. Getting its p2p nature bulk IO is not an issue either.
Pohmelfs is a POSIX frontend to elliptics. It supports weak synchronization between mounted nodes in that regard, that data read/written into local page cache is not synced with the storage until timeout fires. Directory content when read is populated directly into dentry/inode cache instead of doing that per-entry to make directory reading fast.
Yet there are number of features to complete:
- quorum read. pohmelfs supports quorum write only so far
- http compatibility mode - we do want to upload data via pohmelfs and read it through http applications. And vice versa actually too.
- column read-write or more generally file-as-directory feature
- even more testing - abusing dcache is fun, but likely there are hiddens stones
- replace drivers/staging/pohmelfs with this code
That was a geek-style present from Santa. See you next year! Thank you.
1. Elliptics network
http://www.ioremap.net/projects/elliptics
2. Pohmelfs
http://www.ioremap.net/taxonomy/term/4
fs/Kconfig +1 -0
@@ -259,6 +259,7 @@ config NFS_COMMON source "net/sunrpc/Kconfig" source "fs/ceph/Kconfig" source "fs/cifs/Kconfig" +source "fs/pohmelfs/Kconfig" source "fs/ncpfs/Kconfig" source "fs/coda/Kconfig" source "fs/afs/Kconfig"
fs/Makefile +1 -0
@@ -123,3 +123,4 @@ obj-$(CONFIG_GFS2_FS) += gfs2/ obj-$(CONFIG_EXOFS_FS) += exofs/ obj-$(CONFIG_CEPH_FS) += ceph/ obj-$(CONFIG_PSTORE) += pstore/ +obj-$(CONFIG_POHMELFS) += pohmelfs/
fs/pohmelfs/Kconfig new file +11 -0
@@ -0,0 +1,11 @@ +config POHMELFS + tristate "POHMELFS distributed filesystem" + depends on INET && EXPERIMENTAL + select CRYPTO_HASH + help + POHMELFS is a POSIX frontend to Elliptics network + + Elliptics is a key/value storage, which by default imlpements + distributed hash table structure. + + More information can be found at http://www.ioremap.net/projects/elliptics
fs/pohmelfs/Makefile new file +7 -0
@@ -0,0 +1,7 @@ +# +# Makefile for the linux ext2-filesystem routines. +# + +obj-$(CONFIG_POHMELFS) += pohmelfs.o + +pohmelfs-y := dir.o file.o inode.o net.o route.o super.o trans.o symlink.o
fs/pohmelfs/Module.symvers new file +0 -0
fs/pohmelfs/dir.c new file +1001 -0
1,001 lines not on this page · raw message
fs/pohmelfs/file.c new file +320 -0
320 lines not on this page · raw message
fs/pohmelfs/inode.c new file +785 -0
785 lines not on this page · raw message
fs/pohmelfs/net.c new file +603 -0
603 lines not on this page · raw message
fs/pohmelfs/packet.h new file +752 -0
262 lines not on this page · raw message
fs/pohmelfs/pohmelfs.h new file +396 -0
396 lines not on this page · raw message
fs/pohmelfs/route.c new file +279 -0
279 lines not on this page · raw message
fs/pohmelfs/super.c new file +699 -0
699 lines not on this page · raw message
fs/pohmelfs/trans.c new file +378 -0
378 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
Evgeniy Polyakov
Part of the diff is not shown here. View the raw message.