v12.0.1 Luminous (dev) released

TheAnalyst

This is the second development checkpoint release of Luminous, the next long term stable release.

Major changes from 12.0.0

  • The original librados rados_objects_list_open (C) and objects_begin (C++) object listing API, deprecated in Hammer, has finally been removed. Users of this interface must update their software to use either the rados_nobjects_list_open (C) and nobjects_begin (C++) API or the new rados_object_list_begin (C) and object_list_begin (C++) API before updating the client-side librados library to Luminous.

    Object enumeration (via any API) with the latest librados version and pre-Hammer OSDs is no longer supported. Note that no in-tree Ceph services rely on object enumeration via the deprecated APIs, so only external librados users might be affected.

    The newest (and recommended) rados_object_list_begin (C) and object_list_begin (C++) API is only usable on clusters with the SORTBITWISE flag enabled (Jewel and later). (Note that this flag is required to be set before upgrading beyond Jewel.)

  • CephFS clients without the 'p' flag in their authentication capability string will no longer be able to set quotas or any layout fields. This flag previously only restricted modification of the pool and namespace fields in layouts.

  • The rados copy-get-classic operation has been removed since it has not been used by the OSD since before hammer. It is unlikely any librados user is using this operation explicitly since there is also the more modern copy-get.

  • The RGW api for getting object torrent has changed its params from 'get_torrent' to 'torrent' so that it can be compatible with Amazon S3. Now the request for object torrent is like 'GET /ObjectName?torrent'.

Other Notable Changes

  • auth: 'ceph auth import -i' overwrites caps, if caps are not specified (issue#18932, pr#13468, Vikhyat Umrao)
  • BitAllocator: delete useless codes (pr#13619, Jie Wang)
  • Bluestore, NVMEDevice: add the spdk core mask check (pr#14068, optimistyzy)
  • Bluestore, NVMeDevice: fix the core id for rte_remote_launch (pr#13896, optimistyzy)
  • bluestore,NVMEDevice: minor error for get slave core (pr#14012, Ziye Yang)
  • bluestore, NVMEDEVICE: Specify the max io completion in conf (pr#13799, optimistyzy)
  • brag: count the number of mds in fsmap not in mdsmap (issue#19192, pr#13798, Peng Zhang)
  • build/ops: add psmisc dependency to ceph-base (deb and rpm) (issue#19129, pr#13744, Nathan Cutler)
  • build/ops: make package groups comply with openSUSE guidelines (issue#19184, pr#13781, Nathan Cutler)
  • buildpackages: remove because it does not belong (issue#18846, pr#13297, Loic Dachary)
  • build: remove ceph-qa-suite directory (pr#13880, Casey Bodley)
  • ceph_common.sh: fix syntax error (issue#17826, pr#13419, Dan Mick)
  • ceph-create-keys: Add connection timeouts. (pr#11995, Owen Synge)
  • ceph-dencoder: enable bluestore types (pr#13595, Willem Jan Withagen, Kefu Chai)
  • ceph-detect-init: Add docker detection (pr#13218, Guillaume Abrioux)
  • ceph-detect-init: Adds Oracle Linux Server and Oracle VM Server detect (pr#13917, Nikita Gerasimov)
  • ceph-disk: ability to use a different cluster name with dmcrypt (issue#17821, pr#11786, Sébastien Han, Erwan Velu)
  • ceph-disk: dmcrypt activate must use the same cluster as prepare (issue#17821, pr#13573, Loic Dachary)
  • ceph-disk: Fix getting wrong group name when --setgroup in bluestore (issue#18955, pr#13457, craigchi)
  • ceph-disk: FreeBSD changes to get it working and passing tests (pr#12086, Willem Jan Withagen)
  • ceph-disk: Reporting /sys directory in get_partition_dev() (pr#14080, Erwan Velu)
  • ceph-disk: Revert "Revert "change get_dmcrypt_key test to support different cluster name"" (pr#13600, Loic Dachary)
  • ceph-disk/tests: Certain partition types do not work on FreeBSD (pr#13560, Willem Jan Withagen)
  • ceph: do not throw TypeError on connection failure (pr#13268, Kefu Chai)
  • ceph_fuse: fix daemonization when pid file is non-empty (pr#13532, "Yan, Zheng")
  • ceph.in: add help for locally-handled commands (pr#13288, Dan Mick)
  • ceph.in: Fix couple of minor issues on the messages (pr#12797, Dave Chen)
  • ceph-osd: --flush-journal: sporadic segfaults on exit (issue#18820, pr#13311, Alexey Sheplyakov)
  • ceph.spec.in, debian/control: Add bc to build dependencies (issue#18876, pr#13338, Kyr Shatskyy)
  • ceph_test_objectstore: tolerate fsck EOPNOTSUPP too (pr#13325, Sage Weil)
  • ceph_test_rados_api_misc: avoid livelock from PoolCreationRace (pr#13565, Sage Weil)
  • cleanup: rbd: fix a typo in comment (pr#14049, Dongsheng Yang)
  • cleanup: resolve compiler warnings (pr#13236, Adam C. Emerson)
  • client: priority to verify the correctness of the "flag" (pr#12897, huanwen ren)
  • client: remove dead log code (pr#13093, Patrick Donnelly)
  • client: wait for lastest osdmap when handling set file/dir layout (issue#18914, pr#13580, "Yan, Zheng")
  • cmake: link consumers of libclient with libcommon (issue#18838, pr#13394, Kefu Chai)
  • CMakeLists.txt: suppress unneeded warning about jemalloc (pr#13377, Willem Jan Withagen)
  • common: add override in common and misc (issue#18922, pr#13443, liuchang0812)
  • common: add override in header file (pr#13774, liuchang0812)
  • common: add override in msg subsystem (pr#13771, liuchang0812)
  • common/auth: add override in headers (pr#13692, liuchang0812)
  • common/config_opts.h: Remove deprecated osd_compact_leveldb_on_mount option (issue#19318, pr#14059, Vikhyat Umrao)
  • common/config_opts: improve rdma buffer size to 128k (pr#13510, Haomai Wang)
  • common/EventTrace: fix compiler warning. (pr#13659, Jianpeng Ma)
  • common: Fix clang compilation (pr#13335, Bartłomiej Święcki)
  • common: fix lockdep vs recursive mutexes (pr#9940, Adam Kupczyk)
  • common: fix that $host always expands to localhost instead of actual hostname (issue#11081, pr#12998, liuchang0812)
  • common: include/ceph_features.h uses uint64_t, which is in sys/types.h (pr#13339, Willem Jan Withagen)
  • common/MemoryModel: Bump int to long and drop mallinfo (pr#13453, Xiaoxi Chen)
  • common, osd, tools: Add histograms to performance counters (pr#12829, Bartłomiej Święcki)
  • common/perf_counters.: Remove unnecessary judgment (pr#10407, zhang.zezhu)
  • common: possible lockdep false alarm for ThreadPool lock (issue#18819, pr#13258, Mykola Golub)
  • common: remove n on clog messages (pr#13794, Sage Weil)
  • common/TracepointProvider: add assert if dlopen error. (pr#13430, Jianpeng Ma)
  • common/TrackedOp: make TrackedOp::reset_desc() safe (issue#19110, pr#13702, Sage Weil)
  • common: use ref to avoid unnecessary memory copy (issue#19107, pr#13689, liuchang0812)
  • compressor: fix Mutex::Locker used is not correct (pr#13935, hechuang)
  • compressor/zstd: add zstd to embedded ceph (pr#13159, Bassam Tabbara)
  • crc32c: optimize aarch64 crc32c implementation (pr#12977, wei xiao)
  • crush: add devices class that rules can use as a filter (issue#18943, pr#13444, Loic Dachary)
  • crush: add --dump to crushtool (pr#13726, Loic Dachary)
  • crush: allow uniform buckets with no items (pr#13521, Loic Dachary)
  • crush: document tunables and rule step set_ (pr#13722, Loic Dachary)
  • crush: do is_out test only if we do not collide (pr#13326, xie xingguo)
  • crush: fix dprintk compilation (pr#13424, Loic Dachary)
  • debian: Add missing tp files in deb packaging (pr#13526, Ganesh Mahalingam)
  • debian/control: add ceph-base-dbg (pr#13796, Sage Weil)
  • debian: drop boost build dependencies (pr#13524, Kefu Chai)
  • doc: add changelog for v0.94.10 (pr#13572, Abhishek Lekshmanan)
  • doc: add changelog for v10.2.6 Jewel release (pr#13839, Abhishek Lekshmanan)
  • doc: add optional argument for build-doc (pr#14058, Kefu Chai)
  • doc: clarify that "ms bind ipv6" disables IPv4 (pr#13317, Ken Dreyer)
  • doc: crush: API documentation fixes (pr#13589, Loic Dachary)
  • doc: crush typo in algorithm description (pr#13661, Loic Dachary)
  • doc: deletes duplicated word and clarifies an example (pr#13746, Tahia Khan)
  • doc: document osd-agent-{max,low}-ops options (pr#13648, Kefu Chai)
  • doc: fix a typo (pr#13930, Drunkard Zhang)
  • doc: fixes a broken hyperlink to RADOS paper in architecture (pr#13682, Tahia Khan)
  • doc: Fixes a typo. (pr#13985, Edwin F. Boza)
  • doc: Fixes parameter name in rbd configuration on openstack havana/icehouse (issue#17978, pr#13403, Michael Eischer)
  • doc: fixes to silence sphinx-build (pr#13997, Kefu Chai)
  • doc: fix the links to http://ceph.com/docs (issue#19090, pr#13976, Kefu Chai)
  • doc: Fix typo and grammar in RGW config reference (pr#13356, Ruben Kerkhof)
  • doc: fix typos in radosgw-admin usage (pr#13936, Enming Zhang)
  • doc: hammer 0.94.10 release notes (pr#13152, Nathan Cutler)
  • doc: Have install put manpages in the FreeBSD correct location (pr#13301, Willem Jan Withagen)
  • doc: improve firewalld instructions (pr#13360, Ken Dreyer)
  • doc: instructions and guidance for multimds (issue#19135, pr#13830, John Spray)
  • doc: instructions for provisioning OpenStack VMs ad hoc (pr#13368, Nathan Cutler)
  • doc: Jewel 10.2.6 release notes (pr#13835, Abhishek Lekshmanan)
  • doc: kernel client os-recommendations update (pr#13369, John Spray, Ilya Dryomov)
  • doc: mention ENXIO change in the 10.2.6 release notes (pr#13878, Nathan Cutler)
  • doc: minor changes in fuse client config reference (pr#13065, Barbora Ančincová)
  • doc: misc minor fixes (pr#13713, Drunkard Zhang)
  • doc: Modify Configuring Cinder section (issue#18840, pr#13400, Shinobu Kinjo)
  • doc/release-notes: avoid 'production-ready' in describing kraken (pr#13675, Sage Weil)
  • doc: releases update the luminous, hammer, jewel release dates (pr#13584, Abhishek Lekshmanan)
  • doc: remove duplicated references (pr#13396, Kefu Chai)
  • doc: remove mentions about mon_osd_min_down_reports (issue#19016, pr#13558, Barbora Ančincová)
  • doc: rgw: make a note abt system users vs normal users (issue#18889, pr#13461, Abhishek Lekshmanan)
  • docs: Fix problems with example code (pr#14007, Brad Hubbard)
  • doc: Update adminops.rst (pr#13893, Chu, Hua-Rong)
  • doc: Update CephFS disaster recovery documentation (pr#12370, Wido den Hollander)
  • doc: update links to point to ceph/qa instead of ceph-qa-suite (pr#13397, Jan Fajerski, Nathan Cutler)
  • doc: Update sample.ceph.conf (pr#13751, Saumay Agrawal)
  • doc: update to new ceph fs commands (pr#13346, Patrick Donnelly)
  • doc: v12.0.0 release notes (pr#13281, Abhishek Lekshmanan)
  • do_freebsd.sh: Remove ENODATA requirement (pr#13626, Willem Jan Withagen)
  • fix upgrate from hammer when zone doesn't have zoneparams (issue#19231, pr#13900, Orit Wasserman)
  • include/denc, kv: silence gcc warnings (pr#13458, Kefu Chai)
  • include/mempool.h: fix Clangs complaint about types (pr#13523, Willem Jan Withagen)
  • init-ceph: fix ceph user args (pr#13467, Sage Weil)
  • init-ceph: Make init-ceph work under FreeBSD for init-system (pr#13209, Willem Jan Withagen)
  • init-ceph: print trailing n in "status" output (pr#13351, Kefu Chai)
  • librados: add override for librados (issue#18922, pr#13442, liuchang0812)
  • librados: add override in headers (pr#13775, liuchang0812)
  • librados: do not expose non-public symbols (pr#13265, Kefu Chai)
  • librados, osd: clang fixes (pr#13768, Kefu Chai)
  • librados: remove legacy object listing API, clean up newer api (pr#13149, Sage Weil)
  • librados: replace the var name from onack to complete (pr#13857, Pan Liu)
  • librados: use cursor for nobjects listing (pr#13323, Yehuda Sadeh, Sage Weil)
  • librbd: add override keyword in header files (issue#19012, pr#13536, liuchang0812)
  • librbd: add SnapshotNamespace to ImageCtx (pr#12970, Victor Denisov)
  • librbd: add writesame API (pr#12645, Mingxin Liu, Gui Hecheng)
  • librbd: asynchronous clone state machine (pr#12041, Dongsheng Yang)
  • librbd: asynchronous image removal state machine (pr#12102, Dongsheng Yang, Venky Shankar)
  • librbd: eliminate compiler warnings (pr#13729, Jason Dillaman)
  • librbd: fix clang compilation error (issue#19260, pr#13926, Mykola Golub)
  • librbd: fix segfault on EOPNOTSUPP returned while fetching snapshot timestamp (issue#18839, pr#13287, Gui Hecheng)
  • librbd: fix valid coverity warnings (pr#14023, Jason Dillaman)
  • librbd: image create validates that pool supports overwrites (issue#19081, pr#13986, Jason Dillaman)
  • librbd: image-extent cache needs to clip out-of-bounds read buffers (pr#13679, Jason Dillaman)
  • librbd: Include WorkQueue.h since we use it (issue#18862, pr#13322, Boris Ranto)
  • librbd: rbd ack cleanup (pr#13791, runsisi)
  • librbd: relax "is parent mirrored" check when enabling mirroring for pool (issue#19130, pr#13752, Mykola Golub)
  • librbd: scatter/gather support for the C API (issue#13025, pr#13447, Jason Dillaman)
  • librbd: simplify image open/close semantics (pr#13701, Jason Dillaman)
  • librbd: use 'override' keyword instead of 'virtual' (issue#18922, pr#13437, liuchang0812)
  • mailmap: fix Zhao Chao affiliation. (pr#13413, Zhao Chao)
  • mailmap: Liu Yang affiliation (pr#13427, LiuYang)
  • mailmap updates (pr#13309, Loic Dachary)
  • mailmap: Willem Jan Withagen affiliation (pr#13034, Willem Jan Withagen)
  • make-srpm: Pass first parameter to make-dist for building SRPM (pr#13480, Wido den Hollander)
  • man/8/ceph-disk: fix formatting (pr#13969, Kefu Chai)
  • mds: #11950: Persistent purge queue (issue#11950, pr#12786, John Spray)
  • mds: #18600: Clear out tasks that don't make sense from multimds suite (issue#18600, pr#13089, John Spray)
  • mds: Add multimds:thrash sub-suite and fix bugs in thrasher for multimds (issue#18690, issue#10792, pr#13262, Patrick Donnelly)
  • mds: add override in headers (pr#13691, liuchang0812)
  • mds: add override in mds subsystem (issue#18922, pr#13438, liuchang0812)
  • mds: automate MDS object count tracking (pr#13591, Patrick Donnelly)
  • mds: extend 'p' auth cap to cover all vxattr stuff (issue#19075, pr#13628, John Spray)
  • mds: fix handling very fast delete ops (issue#19245, pr#13899, John Spray)
  • mds: fix IO error handling in SessionMap (pr#13464, John Spray)
  • mds: ignore fs full check for CEPH_MDS_OP_SETFILELOCK (issue#18953, pr#13455, "Yan, Zheng")
  • mds/MDLog.cc Fix perf counter type for jlat (pr#13449, Xiaoxi Chen)
  • mds: misc multimds fixes (issue#18717, issue#18754, pr#13227, "Yan, Zheng")
  • mds: print rank as int (issue#19201, pr#13816, Patrick Donnelly)
  • mds: remove some redundant object counters (pr#13704, Patrick Donnelly)
  • mds: replace C_VoidFn in MDSDaemon with lambdas (pr#13465, John Spray)
  • mds/StrayManager: avoid reusing deleted inode in StrayManager::_purge_stray_logged (issue#18877, pr#13347, Zhi Zhang)
  • mds: try to avoid false positive heartbeat timeouts (issue#19118, pr#13807, John Spray)
  • messages/MOSDOp: fix pg_t decoding for version <7 decoding (issue#19005, pr#13537, Sage Weil)
  • mgr: add a get_version to the python interface (pr#13669, John Spray)
  • mgr: add override in headers (pr#13772, liuchang0812)
  • mgr: add override in mgr subsystem (issue#18922, pr#13436, liuchang0812)
  • mgr/MgrClient: use unique_ptr for MgrClient::session (issue#19097, pr#13685, Kefu Chai)
  • mgr: use unique_ptr for MgrStandby::active_mgr (pr#13667, John Spray)
  • misc: SCA and Coverity Fixes (pr#13208, Danny Al-Gaaf)
  • mon: add override in headers (pr#13693, liuchang0812)
  • mon: add override in mon subsystem (issue#18922, pr#13440, liuchang0812)
  • mon: add warn info for osds were removed from osdmap but still kept in crushmap (pr#12273, song baisen)
  • mon: avoid start election twice when quorum enter (pr#10150, song baisen)
  • mon: crush straw_calc_version value is 0 or 1 not 0 to 2. (pr#13554, song baisen)
  • mon: detect existing fs and duplicate name earlier (issue#18964, pr#13471, Patrick Donnelly)
  • mon: drop useless assignment statements (pr#13958, wangzhengyong)
  • mon: enable luminous monmap feature on full quorum (pr#13379, Joao Eduardo Luis)
  • mon: fix force_pg_create pg stuck in creating bug (issue#18298, pr#12539, Sage Weil)
  • mon: in output of "ceph osd df tree", display "-", not "0", for pg amount of a bucket (pr#13015, Chuanhong Hong)
  • mon/MDSMonitor: remove create_new_fs from header (pr#14019, Henrik Korkuc)
  • mon/MonClient: discard stray messages from non-acitve conns (issue#19015, pr#13656, Kefu Chai)
  • mon/MonClient: don't return zero global_id (issue#19134, pr#13853, "Yan, Zheng", Kefu Chai)
  • mon/MonClient: hunt monitors in parallel (issue#16091, pr#11128, Steven Dieffenbach, Kefu Chai)
  • mon/MonClient: persist global_id across re-connecting (issue#18968, pr#13550, Kefu Chai)
  • mon/MonClient: random all ranks then pick first_n (pr#13479, Mingxin Liu)
  • mon,osd: luminous feature bits, require flags, upgrade gates (pr#13278, Sage Weil)
  • mon: OSDMonitor add check only concern our self cluster command (pr#10309, song baisen)
  • mon/OSDMonitor: fix dividing by zero in OSDUtilizationDumper (pr#13531, Mingxin Liu)
  • mon/OSDMonitor: make mapping job behave if mon_osd_prime_pg_temp = false (issue#19020, pr#13574, Sage Weil)
  • mon/OSDMonitor: remove trivial PGMap dependency for 'osd primary-temp' command (pr#13616, Sage Weil)
  • mon/OSDMonitor: some cleanup for reweight-by-pg (pr#13462, Haodong Tang)
  • mon,osd: new mechanism for managing full and nearfull OSDs for luminous (pr#13615, Sage Weil)
  • mon/PGMap: factor mon_osd_full_ratio into MAX AVAIL calc (issue#18522, pr#12923, Sage Weil)
  • mon: PGMonitor add check only concern our self cluster command (pr#9976, song baisen)
  • mon/PGMonitor: rm nonused function (pr#14033, Wei Jin)
  • mon: refactor MDSMonitor command handling (pr#13581, John Spray)
  • mon: remove the redudant jugement in paxosservice is_writeable function (pr#10240, song baisen)
  • mon: remove unnecessary function declaration (pr#13762, liuchang0812)
  • mon: restructure prime_pg_temp around a full pg mapping calculated on multiple CPUs (pr#13207, Sage Weil)
  • mon: smooth io/recovery stats over longer period (pr#13249, Sage Weil)
  • mon: Update OSDMon.cc comments (pr#13750, Saumay Agrawal)
  • msg/async: avoid lossy connection sending ack message (pr#13700, Haomai Wang)
  • msg/async: cleanup code. (pr#13304, Jianpeng Ma)
  • msg/async: fix crash that writing char to nonblock-fd gets EAGAIN in EventCenter::wakeup (pr#13822, liuchang0812)
  • msg/AsyncMessenger: remove unused method (pr#10125, Michal Jarzabek)
  • msg/async/rdma: add log to show correct destruct queuepair (pr#13412, Haomai Wang)
  • msg/async/rdma: add perf counters to RDMA backend (pr#13484, Haomai Wang)
  • msg/async/rdma: check if exp verbs avail (pr#13391, Oren Duer, Adir Lev)
  • msg/async/rdma: check ulimit (pr#13655, Sarit Zubakov, Adir Lev)
  • msg/async/rdma: cleanup (pr#13509, Haomai Wang)
  • msg/async/rdma: compile with rdma as default (pr#13901, DanielBar-On)
  • msg/async/rdma: destroy QueuePair if needed (pr#13810, Haomai Wang)
  • msg/async/rdma: don't need to delete event when tcp connection isn't … (pr#13528, Haomai Wang)
  • msg/async/rdma: Fix broken compilation (pr#13603, Sarit Zubakov)
  • msg/async/rdma: fix outstanding queuepair when destruct RDMAStack (pr#13905, Haomai Wang)
  • msg/async/rdma: fix potential racing connection usage (pr#13738, Haomai Wang)
  • msg/async/rdma: Introduce Device.{cc,h} (pr#14001, Amir Vadai)
  • msg/async/rdma: make Infiniband can be forkable (pr#13525, Haomai Wang)
  • msg/async/rdma: move active_queue_pairs perf counter dec to polling (pr#13716, DanielBar-On)
  • msg/async/rdma: Print error only on ENOMEM (pr#13538, Sarit Zubakov)
  • msg/async/rdma: refactor tx handle flow to get rid of locks (pr#13680, Haomai Wang)
  • msg/async/rdma: rename chunk_size to buffer_size (pr#13666, Adir Lev)
  • msg/async/rdma: update destructor message (pr#13539, Sarit Zubakov)
  • msg/async/rdma: zero wqe inline (pr#13392, Adir Lev)
  • msg/async/rdm: fix leak when existing failure in ip network (pr#13435, Haomai Wang)
  • msg/async: remove useless close function (pr#13286, liuchang0812)
  • msg/async: set thread name for msgr worker (pr#13699, Haomai Wang)
  • msg/async/Stack.cc: use of pthread_setname_np() needs compat.h (pr#13825, Willem Jan Withagen)
  • msg/async: support IPv6 QoS. (issue#18887, issue#18928, pr#13418, Robin H. Johnson)
  • msg: end parameter in entity_addr_t::parse is optional (pr#13650, Mykola Golub)
  • msg: Fix calls to Messenger::create with new parameter (pr#13329, Sarit Zubakov)
  • msg, messages: coverity fixes (pr#13473, Kefu Chai)
  • msg: no need to pass supported features to Messenger::Policy ctor (pr#13785, Sage Weil)
  • msg/simple: fix missing unlock when already bind (pr#13267, Haomai Wang)
  • msg/simple/Pipe: support IPv6 QoS. (issue#18887, pr#13370, Robin H. Johnson)
  • msg/simple/Pipe:the returned value for do_recv unequal to zero (pr#10272, zhang.zezhu)
  • os/aio: remove the redundant memset(struct iocb) (pr#13662, Jianpeng Ma)
  • os/blestore/NVMEDevice: fix the I/O logic for read (pr#13971, optimistyzy)
  • os/bluestore: add bluestore_prefer_wal_size option (pr#13217, Sage Weil)
  • os/bluestore: add flush_store_cache cmd (pr#13428, xie xingguo)
  • os/bluestore: add more perf_counters to BlueStore (pr#13274, Igor Fedotov)
  • os/bluestore: add new garbage collector (pr#12144, Igor Fedotov)
  • os/bluestore: add "_" prefix for internal methods (pr#13409, xie xingguo)
  • os/bluestore/Allocator: drop unused return value in release function (pr#13913, wangzhengyong)
  • os/bluestore/BitAllocator: fix bug of checking required blocks (pr#13470, wangzhengyong)
  • os/bluestore/BitMapAllocator: rm unused variable (pr#13599, Jie Wang)
  • os/bluestore/BlueStore.cc:remove unuse code in _open_bdev() (pr#13553, yonghengdexin735)
  • os/bluestore: cleanup, got rid of table reference of 1<<x (pr#13718, Adam Kupczyk)
  • os/bluestore: default 16KB min_alloc_size on ssd (pr#14076, Sage Weil)
  • os/bluestore: do not use nullptr to calc the size of bluestore_pextent_t (pr#14030, Kefu Chai)
  • os/bluestore: enable SSE-assisted CRC32 calculations in RocksDB (pr#13741, Radoslaw Zarzynski)
  • os/bluestore: fix a bug in small write handling on sharded extents (pr#13728, Igor Fedotov)
  • os/bluestore: fix bug in aio_read() (pr#13511, tangwenjun)
  • os/bluestore: fix bug in _open_super_meta() (pr#13559, Taeksang Kim)
  • os/bluestore: fix bugs in bluefs and bdev flush (issue#19250, issue#19251, pr#13911, Sage Weil)
  • os/bluestore: fix coredump in register_ctrlr() (pr#13556, tangwenjun)
  • os/bluestore: fix deferred writes; improve flush (pr#13888, Sage Weil)
  • os/bluestore: fix wal-queue bytes-counter to keep pace with others (pr#13382, xie xingguo)
  • os/bluestore: leverage the type knowledge in BitMapAreaLeaf. (pr#13736, Radoslaw Zarzynski)
  • os/bluestore: "noid" is not always necessary in clone op (pr#13769, wangzhengyong)
  • os/bluestore: partial reshard support (pr#13162, Sage Weil)
  • os/bluestore: remove CephContext* from BmapEntry. (pr#13651, Radoslaw Zarzynski)
  • os/bluestore: remove unneeded indirection in BitMapZone. (pr#13743, Radoslaw Zarzynski)
  • os/bluestore: remove unused local variable "pos" (pr#13715, wangzhengyong)
  • os/bluestore rm unused variable in aio_read() (pr#13530, tangwenjun)
  • os/bluestore: silence gcc warning (pr#14028, Kefu Chai)
  • os/bluestore: some cleanup (pr#13390, liuchang0812)
  • os/bluestore,test/ceph_test_objectstore: silence gcc warnings (pr#13924, Kefu Chai)
  • os/bluestore: the exhausted check in BitMapZone can be lock-less. (pr#13653, Radoslaw Zarzynski)
  • osd: adding PerfCounters for backoff throttle (pr#13017, Chuanhong Wang)
  • osd: add is_split check before _start_split (pr#13307, song baisen)
  • osd: add override in osd subsystem (issue#18922, pr#13439, liuchang0812)
  • osd: add snap trim reservation and re-implement osd_snap_trim_sleep (pr#13594, Samuel Just)
  • osdc: clean up osd_command/start_mon_command interfaces (pr#13727, John Spray)
  • osdc: fix osdc_osd_seesion perf counter. (pr#13478, Xiaoxi Chen)
  • osd: change a few messages at level 0 and 1; change default level to 1/5 (pr#13407, Sage Weil)
  • osd: clarify REQUIRE_LUMINOUS error message (pr#13363, Josh Durgin)
  • osdc/Objecter: fix bugs in explicit naming of op spg_t (pr#13534, Sage Weil)
  • osdc/Objecter: fix possible OSDSession leak on wrong connection (pr#13365, xie xingguo)
  • osdc/Objecter: resend RWORDERED ops on full (issue#19133, pr#13759, Sage Weil)
  • osd: constify OpRequest::get_req(); fix a few cases of operator<< vs mutated message races (pr#13545, Sage Weil)
  • osd: correct epoch setting of osd boot msg (pr#12623, Mingxin Liu)
  • osd: correct the func name in execute_ctx() log messages (pr#13582, Gu Zhongyan)
  • osd: debug con in ms_handle_connect (pr#13540, Sage Weil)
  • osd/: don't leak context for Blessed*Context or RecoveryQueueAsync (issue#18809, pr#13342, Samuel Just)
  • osd: don't share osdmap with objecter when preboot (issue#15025, pr#13946, Mingxin Liu)
  • osd: don't use ORDERSNAP for flush; always request/send ondisk ack (issue#18961, pr#13570, Samuel Just)
  • OSD: drop parameter t from merge_log() (pr#13923, xie xingguo)
  • osd: drop support for listing objects at a given snap (pr#13398, Sage Weil)
  • osd/ECBackend: drop duplicated pending_commit field from << operator (pr#13665, xie xingguo)
  • osd: fall back to failsafe threshold if osdmap doesn't set [near]full (pr#14004, Sage Weil)
  • osd: faster dispatch (pr#13343, Sage Weil)
  • osd: fix a signed/unsigned warning in PG (pr#13922, Greg Farnum)
  • osd: fix func name in log produced by handle_pg_peering_evt() (pr#13801, xie xingguo)
  • osd: fix stat sum update of recovery pushing (pr#13328, Zhiqiang Wang)
  • osd: fix the setting of soid in sub_op_push (pr#13353, Zhiqiang Wang)
  • osd: have clients resend ops on pg split (pr#13235, Sage Weil)
  • osd: kill sortbitwise (pr#13321, Sage Weil)
  • osd,osdc: pg and osd-based backoff (pr#12342, Sage Weil)
  • osd: osd discussion docs (pr#13344, Greg Farnum)
  • osd/osd_internal_types: wake snaptrimmer on put_read lock, too (issue#19131, pr#13755, Sage Weil)
  • osd/OSDMap: don't set weight to IN when OSD is destroyed (issue#19119, pr#13730, Ilya Dryomov)
  • osd/PG: conditionally retry on receiving pg-notify when Primary is Incomplete (pr#13942, xie xingguo)
  • osd/PGLog: fix index for parent and child log on split (issue#18975, pr#13493, Sage Weil)
  • osd/PG: restrict want_acting to up+acting on recovery completion (issue#18929, pr#13420, Sage Weil)
  • osd/Pool: Disallow enabling 'hashpspool' option to a pool without '--yes-i-really-mean-it' (issue#18468, pr#13406, Vikhyat Umrao)
  • osd/PrimaryLogPG: remove duplicated code. (pr#13894, Jianpeng Ma)
  • osd: remove copy-get-classic (pr#13547, Sage Weil)
  • osd: remove sortbitwise thrashing (pr#13296, Sage Weil)
  • osd: replace object_info_t::operator=() with decode() (pr#13938, tang.jin)
  • osd: small clear up and optimize on _recover_now and should_share_map function (pr#13476, song baisen)
  • osd: the osd should not share map with others when it is in stopping state (pr#13668, song baisen)
  • osd: various changes for preventing internal ENOSPC condition (issue#16878, pr#13425, David Zafman)
  • osd: we know the definite epoch of marking down (pr#13121, Mingxin Liu)
  • os/filestore: avoid unnecessary copy in filestore::_do_transaction (pr#12578, Yunchuan Wen)
  • os/filestore: debug which omap keys are set (issue#19067, pr#13671, Sage Weil)
  • os/filestore/FileJournal: bufferlist rebuild (pr#13980, Jianpeng Ma)
  • os/filestore/FileStore.cc: remove unneeded loop (pr#12177, Li Wang)
  • os/filestore/HashIndex: be loud about splits (issue#18235, pr#12421, Dan van der Ster)
  • os/filestore: use existing variable for same func. (pr#13742, Pan Liu)
  • os/FuseStore: includeheader in src/os/FuseStore.h for gcc 7.x (pr#13454, Jos Collin)
  • PendingReleaseNotes: note the fuse fstab format change (pr#13259, John Spray)
  • pybind/ceph_daemon: use small chunk for recv (pr#13804, Xiaoxi Chen)
  • pybind: cephfs should be built without librados / python-rados (pr#13431, Kefu Chai)
  • pybind: fix docstring for librbd Python binding (pr#13977, runsisi)
  • qa: add supported distros for ceph-ansible (pr#13711, Tamil Muthamizhan)
  • qa: add workunit to test krbd data-pool support (pr#13482, Ilya Dryomov)
  • qa: fix race in Mount.open_background (issue#18661, pr#13137, John Spray)
  • qa: handle SSHException in logrotate (pr#13359, John Spray)
  • qa/rados/upgrade/jewel-x-singleton: run luminous.yaml at the end (pr#13378, Sage Weil)
  • qa/suites/{ceph-ansible,rest}: OpenStack volumes (pr#13672, Zack Cerza)
  • qa/suites/ceph-deploy: Drop OpenStack volume count (pr#13706, Zack Cerza)
  • qa/suites: fix upgrade tests vs cluster full thrashing (pr#13852, Sage Weil)
  • qa/suites/fs: Add openstack volume configuration (pr#13640, Zack Cerza)
  • qa/suites/kcephfs: Openstack volume configuration (pr#13634, Zack Cerza)
  • qa/suites/{knfs,hadoop,samba}: OpenStack volume configuration (pr#13637, Zack Cerza)
  • qa/suites/krbd: Add openstack volume configuration (pr#13631, Zack Cerza)
  • qa/suites/rados/objectstore: enable experimental features for testing bluestore (pr#13456, Kefu Chai, Dan Mick)
  • qa/suites/rgw: Add openstack volume configuration (pr#13611, Zack Cerza)
  • qa/suites/rgw/thrash: add osd thrashing tests (pr#13445, Sage Weil)
  • qa/suites/upgrade: add tiering test to hammer-jewel-x (issue#19185, pr#13805, Kefu Chai)
  • qa/suites/upgrade/kraken-x: do not thrash cluster full during upgrade (issue#19232, pr#13892, Dan Mick)
  • qa/suites/upgrade/kraken-x (pr#13517, Sage Weil, Yuri Weinstein)
  • qa/suite/upgrade/jewel-x: various fixes (pr#13734, Sage Weil)
  • qa/tasks/ceph.py: debug which pgs aren't scrubbing (pr#13649, Sage Weil)
  • qa/tasks: force umount during kclient teardown (issue#18663, pr#13099, John Spray)
  • qa/tasks/rgw.py: start Apache before RadosGW. (pr#13846, Radoslaw Zarzynski)
  • qa/tasks/workunit: use ceph.git as an alternative of ceph-ci.git for cloning workunit (pr#13663, Kefu Chai)
  • qa/tasks/workunit: use the suite repo for cloning workunit (pr#13452, Kefu Chai)
  • qa/tasks/workunit: use the suite repo for cloning workunit (pr#13625, Kefu Chai)
  • qa/workunits/rados/test.sh: print test name when it fails (pr#13264, Kefu Chai)
  • qa/workunits/rbd: resolve potential rbd-mirror race conditions (issue#18935, pr#13421, Jason Dillaman)
  • qa/workunits/rbd: tweak rbd-mirror config to spead up testing (pr#13228, Mykola Golub)
  • rados: allow "rados purge" to delete objects when osd is full (pr#13814, Pan Liu)
  • rados: we need to get the latest osdmap when pool does not exists (pr#13289, song baisen)
  • rbd: demote/promote all mirrored images in a pool (issue#18748, pr#13758, Jason Dillaman)
  • rbd: fix typo in Kernel.cc (issue#19273, pr#13983, Gaurav Kumar Garg)
  • rbd: introduce v2 format for rbd export/import (issue#13186, pr#10487, Dongsheng Yang)
  • rbdmap: consider /etc/ceph/rbdmap when unmapping images (issue#18884, pr#13361, David Disseldorp)
  • rbd-mirror A/A: leader should track up/down rbd-mirror instances (issue#18784, pr#13571, Mykola Golub)
  • rbd-mirror: deleting a snapshot during sync can result in read errors (issue#18990, pr#13568, Jason Dillaman)
  • rbd-mirror: InstanceWatcher watch/notify stub for leader/follower RPC (issue#18783, pr#13312, Mykola Golub)
  • rbd-mirror: replace remote pool polling with add/remove notifications (issue#15029, pr#12364, Jason Dillaman)
  • rbd-mirror: track images via global image id (pr#13416, Jason Dillaman)
  • rbd-nbd: check /sys/block/nbdX/size to ensure kernel mapped correctly (issue#18335, pr#13229, Mykola Golub)
  • rbd-nbd: create admin socket only for map command (issue#17951, pr#12433, Pan Liu)
  • rbd-nbd: don't ignore --read-only option in BLKROSET ioctl (pr#13944, Pan Liu)
  • rbd-nbd: fix a typo "moudle" (pr#13652, Pan Liu)
  • rbd-nbd: fix typo in comment (pr#14034, Pan Liu)
  • rbd-nbd: no need to check image format any more (pr#13389, Mykola Golub)
  • rbd-nbd: update size only when NBD_SET_SIZE successful (pr#14005, Pan Liu)
  • rbd-nbd: warn when kernel parameters are ignored (issue#19108, pr#13694, Pan Liu)
  • rbd: prevent adding multiple mirror peers to a single pool (issue#19256, pr#13919, Jason Dillaman)
  • rbd: spell out image features unsupported by the kernel (issue#19095, pr#13812, Ilya Dryomov)
  • rbd: use concurrent writes for imports (issue#19034, pr#13782, Venky Shankar)
  • rbd: When Ceph cluster becomes full, should allow user to remove rbd … (pr#12627, Pan Liu)
  • ReplicatedBackend: don't queue Context outside of ObjectStore with obc (issue#18927, pr#13569, Samuel Just)
  • Revert "dummy: reduce run time, run user.yaml playbook" (issue#18259, pr#12506, Nathan Cutler)
  • Revert "qa/tasks/workunit: use the suite repo for cloning workunit" (pr#13495, Sage Weil)
  • Reviewed by: Yan, Zheng <zyan@redhat.com> (issue#18830, pr#13272, John Spray)
  • rgw: AbortMultipart request returns NoSuchUpload error if the meta obj doesn't exist (pr#12793, Zhang Shaowen)
  • rgw: add apis to support ragweed (pr#13645, Yehuda Sadeh)
  • rgw: add override in header files mostly (pr#13586, liuchang0812)
  • rgw: add override in rgw subsystem (issue#18922, pr#13441, liuchang0812)
  • rgw: add radosclient finisher to perf counter (issue#19011, pr#13535, lvshuhua)
  • rgw: add support for noncurrentversion expiration in s3 lifecycle. (issue#18916, pr#13385, Zhang Shaowen)
  • rgw-admin: remove deprecated regionmap commands (issue#18725, pr#13963, Casey Bodley)
  • rgw: change default chunk size to 4MB (issue#18621, issue#18622, issue#18623, pr#13035, Yehuda Sadeh)
  • rgw: change loglevel to 20 for 'System already converted' message (issue#18919, pr#13399, Vikhyat Umrao)
  • rgw: change loglevel to 5 in user's quota sync. (issue#18921, pr#13408, Zhang Shaowen)
  • rgw: clean redundant code (pr#13302, Yankun Li)
  • rgw: cleanup lifecycle managament (pr#13820, Jiaying Ren)
  • rgw: clean up the redundant assignment in last_entry_in_listing (pr#13387, Jing Wenjun)
  • rgw: cleanup unused var in rgw/rgw_rest_s3.cc (pr#13434, Jiaying Ren)
  • rgw: clear old zone short ids on period update (issue#15618, pr#13949, Casey Bodley)
  • rgw: correct the debug info when unlink instance failed. (pr#13761, Zhang Shaowen)
  • rgw: Correct the return codes for the health check feature (issue#19025, pr#13557, Pavan Rallabhandi)
  • rgw: data sync includes instance in rgw_obj_index_key (pr#13948, Casey Bodley)
  • rgw: don't init rgw_obj from rgw_obj_key when it's incorrect to do so (issue#19096, pr#13676, Yehuda Sadeh)
  • rgw: don't log the env_map twice (pr#13481, Abhishek Lekshmanan)
  • rgw: don't return skew time error in pre-signed url (issue#18828, pr#13354, liuchang0812)
  • rgw: error_code in error log is not right when data sync fails. (issue#18437, pr#12810, Zhang Shaowen)
  • rgw_file: avoid stranding invalid-name bucket handles in fhcache (issue#19036, pr#13590, Matt Benjamin)
  • rgw_file: ensure valid_s3_object_name for directories, too (issue#19066, pr#13614, Matt Benjamin)
  • rgw_file: fix double unref on rgw_fh for rename (pr#13988, Gui Hecheng)
  • rgw_file: fix fs_inst progression (issue#19214, pr#13832, Matt Benjamin)
  • rgw_file: fix non-negative return code for open operation (pr#14045, Gui Hecheng)
  • rgw_file: fix reversed return value of getattr (pr#13895, Gui Hecheng)
  • rgw_file: implement reliable has-children check (unlink dir) (issue#19270, pr#13953, Matt Benjamin)
  • rgw_file: posix style atime,ctime,mtime (pr#13765, Gui Hecheng)
  • rgw_file: RGWFileHandle dtor must also cond-unlink from FHCache (issue#19112, pr#13712, Matt Benjamin)
  • rgw: fix break inside of yield in RGWFetchAllMetaCR (issue#17655, pr#11586, Casey Bodley)
  • rgw: fix disabling Swift's object versioning through empty X-Versions-Location (issue#18852, pr#13303, Jing Wenjun)
  • rgw: fix error code of inexistence of versions location in swift api (issue#18880, pr#13350, Jing Wenjun)
  • rgw:Fixes typo in rgw_admin.cc (issue#19026, pr#13576, Ronak Jain)
  • rgw: fix for broken yields in RGWMetaSyncShardCR (issue#18076, pr#12223, Casey Bodley)
  • rgw: fix init_bucket_for_sync retcode (pr#13684, Shasha Lu)
  • rgw: fix transition from full to incremental meta sync (pr#13920, Casey Bodley)
  • rgw: fix typo in comment (pr#13578, liuchang0812)
  • rgw: get torrent request's parameter is not the same as amazon s3. (issue#19136, pr#13760, Zhang Shaowen)
  • rgw: handle error return value in build_linked_oids_index (pr#13955, wangzhengyong)
  • rgw: http_client clarify the debug msg function call (pr#13688, Abhishek Lekshmanan)
  • rgw: if user.email is empty, dont try to delete (issue#18980, pr#13783, Casey Bodley)
  • rgw: improve handling of illformed Swift's container ACLs. (issue#18796, pr#13248, Radoslaw Zarzynski)
  • rgw: Let the object stat command be shown in the usage (issue#19013, pr#13291, Pavan Rallabhandi)
  • rgw: librgw refcnt (pr#13405, Matt Benjamin)
  • rgw: make sending Content-Length in 204 and 304 responses controllable (issue#16602, pr#10156, Radoslaw Zarzynski)
  • rgw: make sync thread name clear (issue#18860, pr#13324, lvshuhua)
  • rgw: print is_admin as int instead of __u8 (pr#12264, Casey Bodley)
  • rgw: put object's acl can't work well on the latest object (issue#18649, pr#13078, Zhang Shaowen)
  • rgw: remove redundant codes in rgw_cache.h (pr#13902, lihongjie)
  • rgw: remove useless --tier_type in radosgw-admin. (pr#13856, Zhang Shaowen)
  • rgw: rest_admin/user avoid double checking input args (pr#13460, Abhishek Lekshmanan)
  • rgw/rgw_main.cc: fix parenteses and function result (pr#12295, Willem Jan Withagen)
  • rgw: set dumpable flag after setuid post ff0e521 (issue#19089, pr#13657, Brad Hubbard)
  • rgw: set FCGI_INCLUDE_DIR for cephd_rgw_base (issue#18918, pr#13393, David Disseldorp)
  • rgw structures rework (issue#17996, issue#19249, pr#11485, Yehuda Sadeh)
  • rgw: use rgw_zone_root_pool for region_map like is done in hammer (issue#19195, pr#13928, Orit Wasserman)
  • rgw: use separate http_manager for read_sync_status (issue#19236, pr#13660, Shasha Lu)
  • rgw: wip dir orphan (issue#18992, issue#18989, issue#19018, issue#18991, pr#13529, Matt Benjamin)
  • rgw: wip parentref (issue#19060, issue#19059, pr#13607, Matt Benjamin)
  • rocksdb: sync with upstream (issue#18464, pr#13306, Kefu Chai)
  • rpm: build ceph-resource-agents by default (issue#17613, pr#13515, Nathan Cutler)
  • rpm: disable dwz to speed up valgrind (issue#19099, pr#13748, Kefu Chai)
  • rpm: drop boost build dependencies (pr#13519, Nathan Cutler)
  • script/find_dups_in_pg_log: scrip to find dup requests due to short pg logs (pr#13417, Sage Weil)
  • script/sepia_bt.sh: get sha1,release from t.log if it's not in core (pr#13620, Kefu Chai)
  • script/sepia_bt.sh: no need to pass version and sha1 anymore (pr#13380, Kefu Chai)
  • script/sepia_bt.sh: support xenial (pr#13292, Kefu Chai)
  • selinux: Allow ceph daemons to read net stats (issue#19254, pr#13945, Boris Ranto)
  • Signed-off-by: Kefu Chai <kchai@redhat.com> (pr#14006, shiqi)
  • systemd: Start OSDs after MONs (issue#18516, pr#13097, Boris Ranto)
  • tasks/cephfs: tear down on mount() failure (pr#13282, John Spray)
  • test: add override in test submodule (pr#13773, liuchang0812)
  • test/ceph-test-objectstore: Don't always include BlueStore code (pr#13516, Willem Jan Withagen)
  • tested by-had, using fault injection (issue#19019, pr#13546, Casey Bodley)
  • test/encoding: fix readable.sh bugs; fix ceph-object-corpus (pr#13678, Sage Weil)
  • test: Fix mismatched sign comparison in histogram test (pr#13362, Adam C. Emerson)
  • test: fix rbd unit test cases w/ striping feature (issue#18888, pr#13196, Venky Shankar)
  • test: fix test_pidfile (pr#13646, yaoning)
  • test/libcephfs: avoid buffer overflow when testing ceph_getdents() (issue#18941, pr#13429, "Yan, Zheng")
  • test/librbd/CMakeLists.txt: ceph_test_librbd_fsx requires linux includes/libs (pr#13630, Willem Jan Withagen)
  • test/librbd: move tests using non-public api to internal (pr#13806, Venky Shankar)
  • test: Need to exclude the fsx executable also on FreeBSD (pr#13686, Willem Jan Withagen)
  • test/rgw: add bucket acl and versioning tests to test_multi.py (pr#12449, Casey Bodley)
  • tests: ceph_test_rados_api_watch_notify: test timeout using rados_wat… (issue#19312, pr#14061, Kefu Chai)
  • tests: drop buildpackages.py (issue#18846, pr#13319, Nathan Cutler)
  • tests: drop obsolete Perl scripts (pr#13951, Nathan Cutler)
  • test: sed on FreeBSD requires "-i extension", so use gsed (pr#13903, Willem Jan Withagen)
  • tests: fix regression in qa/tasks/ceph_master.py (issue#16263, pr#13279, Nathan Cutler, Kefu Chai)
  • tests: osd-scrub-repair.sh disable scrub backoff in test (pr#13334, Kefu Chai)
  • tests: re-enable cephfs python tests on kclient (issue#17193, issue#18161, pr#13200, Nathan Cutler)
  • test/store_test: add deferred test case setup to support explicit min… (issue#18857, pr#13415, Igor Fedotov)
  • tests: update SUSE yaml facets in qa/distros/all (issue#18856, pr#13313, Nathan Cutler)
  • test: support blacklisting within librados_test_stub (pr#13737, Jason Dillaman)
  • test: Thrasher: do not update pools_to_fix_pgp_num if nothing happens (pr#13518, Kefu Chai)
  • test: Thrasher: update pgp_num of all expanded pools if not yet (pr#13367, Kefu Chai)
  • test: unittest_hostname compile error on freebsd (pr#13739, liuchang0812)
  • tools: add override in tool submodule (pr#13776, liuchang0812)
  • tools/rados: Check return value of connect (issue#19319, pr#14057, Brad Hubbard)
  • tools/rados: remove useless function declaration (pr#12566, liuchang0812)
  • tools/scripts:"FreeBSD getopt is not compatible, use the one from packages" (pr#13260, Willem Jan Withagen)
  • tracing: don't include oid when tracing at dequeue_op() (pr#13410, Yehuda Sadeh)
  • upstart: start radosgw-all according to runlevel (issue#18313, pr#12586, Ken Dreyer)
  • verified by hand f23 (issue#19111, pr#13703, Matt Benjamin)
  • vstart: add --help documentation for rgw_num (pr#13817, Ali Maredia)
  • vstart: clean up usage a bit (pr#13138, Sage Weil)
  • vstart: do not add host for mgr.* section if not $overwrite_conf (pr#13767, Kefu Chai)
  • vstart: don't configure rgw_dns_name (pr#13411, Yehuda Sadeh)
  • vstart: don't create cluster by default (pr#13891, Yehuda Sadeh)