v11.1.1 Kraken rc released

TheAnalyst

This is a release candidate for kraken, the next stable release series.

Major Changes from Jewel

  • RADOS:
    • The new BlueStore backend now has a change in the on-disk format, from the previous release candidate 11.1.0 and there might possibly be a change before the final release is cut

Notable Changes

  • bluestore: ceph-disk: adjust bluestore default device sizes (pr#12530, Sage Weil)
  • bluestore: os/bluestore: avoid resharding if the last shard size fall below shar… (pr#12447, Igor Fedotov)
  • bluestore: os/bluestore: clear omap flag if parent has none (pr#12351, xie xingguo)
  • bluestore: os/bluestore: don’t implicitly create the source object for clone (pr#12353, xie xingguo)
  • bluestore: os/bluestore: fix ondisk encoding for blobs (pr#12488, Varada Kari, Sage Weil)
  • bluestore: os/bluestore: fix potential csum_order overflow (pr#12333, xie xingguo)
  • bluestore: os/bluestore: fix target_buffer value overflow in Cache::trim() (pr#12507, Igor Fedotov)
  • bluestore: os/bluestore: include modified objects in flush list even if onode unchanged (pr#12541, Sage Weil)
  • bluestore: os/bluestore: preserve source collection cache during split (pr#12574, Sage Weil)
  • bluestore: os/bluestore: remove ‘extents’ from shard_info (pr#12629, Sage Weil)
  • bluestore: os/bluestore: simplified allocator interfaces to single apis (pr#12355, Ramesh Chander)
  • bluestore: os/bluestore: simplify allocator release flow (pr#12343, Sage Weil)
  • build/ops,common: common/str_list.h: fix clang warning about std::move (pr#12570, Willem Jan Withagen)
  • build/ops: CMakeLists: add vstart-base target (pr#12476, Sage Weil)
  • build/ops: systemd: Fix startup of ceph-mgr on Debian 8 (pr#12555, Mark Korenberg)
  • build/ops: upstart: fix ceph-crush-location default (issue#6698, pr#803, Jason Dillaman)
  • cephfs,cleanup: ceph-fuse: start up log on parent process before shutdown (issue#18157, pr#12358, Kefu Chai)
  • cephfs: client/mds: Clear setuid bits when writing or truncating (issue#18131, pr#12412, Jeff Layton)
  • cephfs: client: fix mutex name typos (pr#12401, Yunchuan Wen)
  • cephfs: client: set metadata[“root”] from mount method when it’s called with … (pr#12505, Jeff Layton)
  • cephfs: get new fsmap after marking clusters down (issue#7271, issue#17894, pr#1262, Patrick Donnelly)
  • cephfs: libcephfs: add readlink function in cephfs.pyx (pr#12384, huanwen ren)
  • cephfs: mon/MDSMonitor: fix iterating over mutated map (issue#18166, pr#12395, John Spray)
  • cephfs: systemd: add ceph-fuse service file (pr#11542, Patrick Donnelly)
  • cephfs: test fragment size limit (issue#16164, pr#1069, Patrick Donnelly)
  • cephfs: test readahead is working (issue#16024, pr#1046, Patrick Donnelly)
  • cephfs: update tests to enable multimds when needed (pr#933, Greg Farnum)
  • cephfs: Port/bootstrap (pr#827, Yan, Zheng)
  • cleanup,common: common/blkdev: use realpath instead of readlink to resolve the recurs… (pr#12462, Xinze Chi)
  • cleanup,rbd: journal: avoid logging an error when a watch is blacklisted (issue#18243, pr#12473, Jason Dillaman)
  • cleanup,rbd: journal: prevent repetitive error messages after being blacklisted (issue#18243, pr#12497, Jason Dillaman)
  • cleanup: Wip ctypos (pr#12495, xianxiaxiao)
  • cleanup: fix typos (pr#12502, xianxiaxiao)
  • cleanup: remove unused declaration (pr#12466, Li Wang, Yunchuan Wen)
  • common: fix clang compilation error (pr#12565, Mykola Golub)
  • common: osd/osdmap: fix divide by zero error (pr#12521, Yunchuan Wen)
  • common: client/Client.cc: fix/silence “logically dead code” CID-Error (pr#291, Yehuda Sadeh)
  • core,cleanup: ceph-disk: do not create bluestore wal/db partitions by default (issue#18291, pr#12531, Loic Dachary)
  • core,cleanup: osd/ReplicatedPG: remove redundant check for balance/localize read (pr#10209, runsisi)
  • core,cleanup: src: rename ReplicatedPG to PrimaryLogPG (pr#12487, Samuel Just)
  • core,performance: osd/PrimaryLogPG: don’t truncate if we don’t have to for WRITEFULL (pr#12534, Samuel Just)
  • core,tests: test/rados/list.cc: Memory leak in ceph_test_rados_api_list (issue#18250, pr#12479, Brad Hubbard)
  • core: mon: make it more clearly to debug for paxos state (pr#12438, song baisen)
  • core: FreeBSD/OSD.cc: add client_messenger to the avoid_ports set. (pr#12463, Willem Jan Withagen)
  • core: ceph.in: allow ‘flags’ to not be present in cmddescs (issue#18297, pr#12540, Dan Mick)
  • core: erasure-code: synchronize with upstream gf-complete (issue#18092, pr#12382, Loic Dachary)
  • core: osd/PG: add “down” pg state (distinct from down+peering) (pr#12289, Sage Weil)
  • core: osd/ReplicatedPG::record_write_error: don’t leak orig_reply on cancel (issue#18180, pr#12450, Samuel Just)
  • core: remove spurious executable permissions on source code files (pr#1061, Samuel Just)
  • doc: doc/dev/osd_internals: add pgpool.rst (pr#12500, Brad Hubbard)
  • doc: document osd tell bench (issue#5431, pr#16, Sage Weil)
  • doc: explain rgw_fcgi_socket_backlog in rgw/config-ref.rst (pr#12548, liuchang0812)
  • doc: final additions to 11.1.0-rc release notes (pr#12448, Abhishek Lekshmanan)
  • doc: mention corresponding libvirt section in nova.conf (pr#12584, Marc Koderer)
  • fs: add snapshot tests to mds thrashing (pr#1073, Yan, Zheng)
  • fs: enable ceph-fuse permission checking for all pjd suites (pr#1187, Greg Farnum)
  • fs: fix two frag_enable fragments (issue#6143, pr#656, Sage Weil)
  • fs: fix up dd testing again (issue#10861, pr#373, Greg Farnum)
  • fs: fuse_default_permissions = 0 for kernel build test (pr#1109, Patrick Donnelly)
  • fs: unify common parts of sub-suites (issue#1737, pr#1282, Patrick Donnelly)
  • librados: Memory leaks in object_list_begin and object_list_end (issue#18252, pr#12482, Brad Hubbard)
  • librbd: ignore error when object map is already locked by current client (issue#16179, pr#12484, runsisi)
  • librbd: keep rbd_default_features setting as bitmask (issue#18247, pr#12486, Jason Dillaman)
  • librbd: properly order concurrent updates to the object map (issue#16176, pr#12420, Jason Dillaman)
  • librbd: remove image header lock assertions (issue#18244, pr#12472, Jason Dillaman)
  • librbd: use proper snapshot when computing diff parent overlap (issue#18200, pr#12396, Xiaoxi Chen)
  • mds: add tests for mantle (programmable balancer) (pr#1145, Michael Sevilla)
  • mds: release pool allocator memory after exceeding size limit (issue#18225, pr#12443, John Spray)
  • osd: Fix map gaps again (bug 15943) (issue#15943, pr#12571, Samuel Just)
  • osd: Increase priority for inactive PGs backfill (pr#12389, Bartłomiej Święcki)
  • osd: When deep-scrub errors present upgrade regular scrubs (pr#12268, David Zafman)
  • osd: default osd_scrub_during_recovery=false (pr#12402, Sage Weil)
  • osd: enhance logging for osd network error (pr#12458, liuchang0812)
  • osd: fix CEPH_OSD_FLAG_RWORDERED (pr#12603, Sage Weil)
  • osd: force watch PING to be write ordered (issue#18310, pr#12590, Samuel Just)
  • osd: mark queued flag for op (pr#12352, Yunchuan Wen)
  • osd: remove the lock heartbeat_update_lock, and change heatbeat_need_… (pr#12461, Pan Liu)
  • osd: osd/OSDMonitor: accept ‘osd pool set ...’ value as string (pr#911, David Zafman)
  • osd: ReplicatedPG: don’t bless C_OSD_SendMessageOnConn (issue#13304, pr#669, Jason Dillaman)
  • osd: PGLog: initialize writeout_from in PGLog constructor (issue#12973, pr#558, Sage Weil)
  • performance,bluestore: os/bluestore: reduce Onode in-memory footprint (pr#12568, Igor Fedotov)
  • performance,common: osd/OSDMap: improve the performance of pg_to_acting_osds (pr#12190, Pan Liu)
  • rbd,tools: rbd : make option –stripe-unit w/ B/K/M work (pr#12407, Jianpeng Ma)
  • rbd: add fsx journal replay test case (pr#821, Jason Dillaman)
  • rbd: add singleton to assert no rbdmap regression (issue#14984, pr#902, Nathan Cutler)
  • rbd: add some missing workunits (pr#870, Josh Durgin)
  • rbd: added rbd-nbd fsx test case (pr#1049, Jason Dillaman)
  • rbd: fix json formatting for image and journal status output (issue#18261, pr#12525, Mykola Golub)
  • rbd: move nbd test workload to separate client host from OSDs (pr#1170, Jason Dillaman)
  • rbd: provision volumes to format as XFS (issue#6693, pr#1028, Loic Dachary)
  • rbd: rbd-nbd: invalid error code for “failed to read nbd request” messages (issue#18242, pr#12483, Mykola Golub)
  • rbd: tests with rbd_skip_partial_discard option enabled (pr#1077, Mykola Golub)
  • rbd: updated tests to use new rbd default feature set (pr#842, Jason Dillaman)
  • rgw: add default zone name (issue#7009, pr#954, Orit Wasserman)
  • rgw: add option to log custom HTTP headers (rgw_log_http_headers) (pr#7639, Matt Benjamin)
  • rgw: add sleep to let the sync agent init (pr#1136, Orit Wasserman)
  • rgw: allow fastcgi idle timeout to be adjusted (pr#230, Sage Weil)
  • rgw: aws4: add presigned url bugfix in runtime (issue#16463, pr#10160, Javier M. Mellid)
  • rgw: data_extra_pool is unique per zone (issue#17025, pr#1119, Orit Wasserman)
  • rgw: do not enable both tcp and uds for fastcgi (issue#5797, pr#479, Andrew Schoen)
  • rgw: do quota tests on ubuntu (issue#6382, pr#635, Sage Weil)
  • rgw: don’t error out on empty owner when setting acls (issue#6892, pr#877, Loic Dachary, Nathan Cutler)
  • rgw: fix etag in multipart complete (issue#17794, issue#6830, issue#16129, issue#17872, pr#1269, Casey Bodley, Orit Wasserman)
  • rgw: fix indentation for cache_pools (issue#8295, pr#251, Sage Weil)
  • rgw: move xfs to a seperate directory (pr#969, Orit Wasserman)
  • rgw: policy acl format should be xml (pr#946, Orit Wasserman)
  • rgw: split osd’s in 2 nodes (issue#15612, pr#1019, Vasu Kulkarni)
  • rgw: use civetweb if no frontend was configured (pr#958, Orit Wasserman)
  • rgw: use explicit flag to cancel RGWCoroutinesManager::run() (issue#17465, pr#12452, Casey Bodley)
  • rgw: we don’t support btrfs any more (pr#1132, Orit Wasserman)
  • tests,bluestore: os/bluestore: add UT for an estimation of Onode in-memory size (pr#12532, Igor Fedotov)
  • tests,rbd: qa/workunits/rbd: fix (issue#18271, pr#12511, Sage Weil)
  • tests: qa/tasks/admin_socket: subst in repo name (pr#12508, Sage Weil)
  • tests: qa/tasks/ceph_deploy: use dev option instead of dev-commit (pr#12514, Vasu Kulkarni)
  • tests: qa/tasks/osd_backfill.py: wait for osd.[12] to start (issue#18303, pr#12577, Sage Weil)
  • tests: qa/workunits: include extension for nose tests (pr#12572, Sage Weil)
  • tests: qa: fixed script to schedule rados and other suites with –subset option (pr#12587, Yuri Weinstein)
  • tests: unittest_throttle avoid ASSERT_DEATH (issue#18036, pr#12393, Loic Dachary)
  • tests: merge ceph-qa-suite
  • tests: paxos fixes (issue#11913, pr#457, John Spray)
  • tools: cleanup phase of cephfs-data-scan (pr#12337, Vishal Kanaujia)
  • tools: osdmaptool: fix divide by zero error (pr#12561, Yunchuan Wen)
  • tools: rados: optionally support reading omap key from file (issue#18123, pr#12286, Jason Dillaman)
  • tools: ceph-post-file: single command to upload a file to cephdrop (pr#505, Dan Mick, Travis Rhoden)
  • tools: osdmaptool: additional tests (pr#1196, Sage Weil)