How to test HDD & SSD for journal / metadata compatibility?

You have read a lot about fast SSDs which do not perform well in a ceph cluster?
SSDs which die fast in a ceph cluster?
Shall you prefer HDDs over SSDs?
You have no clue how to determine what is true or what is a myth?

To understand this article fully you shall read also this both articles:

Available tools under linux for our tests

Under linux we are pretty happy to have a bunch of tools, which help us to test read in depth our drives. Well known tools are

  • fio
    flexible I/O tester
  • dd
    disk dump

Controller dependent impacts on your tests

Linux use disk caches, so also do hardware controllers. These caches will cause wrong tests, since we will test the speed of the RAM instead the speed of the drive.

Disable the linux cache

Linux uses for all drives a cache. Here we need first to disable the write-cache of linux on our drive

sudo hdparm -W 0 /dev/hda 0

In the above example we disable the write cache for the drive /dev/hda

Disable HP controller cache

HP controllers have typically RAID array management, which itself requires also controller based caches to optimize the write and read performance. This caches we also need to disable!

sudo hpacucli ctrl slot=2 modify dwc=disable
sudo hpacucli controller slot=2 logicaldrive 1 modify arrayaccelerator=disable

The above command assumes, that your HP controller is in slot 2 and your drive is the number 1:

Using fio

For the more thorough tests we need to use fio. This is the sample command for our tests:

sudo fio --filename=/dev/<yourDevice> --direct=1 --sync=1 --rw=write --bs=4k --numjobs=<numOfConcurrentThreads> --iodepth=1 --runtime=600 --time_based --group_reporting --name=journal-test

Let us dive into the command options:

  • –filename
    the device we want to test.
    E.g. /dev/sda or /dev/nvme0n1
  • –direct
    here we tell fio to work with O_DIRECT (details see Performance considerations for journal / metadata disks)
  • –sync
    here we teill fio to work with O_DSYNC (details see Performance considerations for journal / metadata disks)
  • –rw
    what IO pattern to use. In our case we use write for sequential writes as journal/metadata writes are always sequential (details see Performance considerations for journal / metadata disks))
  • –bs
    this is the block size. With the blocksize we simulate the object size handed over from a client to our OSD.. In our example here, we are submitting 4K objects.
    4k is is probably a worst case scenario. If you know your workload in terms of block size, you can here modify it to your needs
  • –numjobs
    here we simulate the amount of concurrent client accesses to our ceph OSD. number of threads that will be running, think this has ceph-osd daemons writing to the journal
  • –iodepth
    we are submitting IO one by one.
  • –runtime
    job duration in seconds. Here you shall test different durations to ensure that all optimizations of the HDD/SSD vendor gets overridden to get down to the real performance values of your drive.
    The drive optimizations are typically tiering of different storage types. So this tiers are helping to increase the overall performance. Means something like memory, caches and on SSDs faster SSD cells, as the cells for the final data storage on SSDs.
  • –time_based
    if you have a fast drive, the test could finish the test before reaching the “runtime” limit. So this ensures to run the test for the specified runtime. So basically it reruns the operation over an over again until the total runtime is reached.
  • –group_reporting
    This tells fio to report a overall value. If you have multiple threads (numjobs) usually fio will report each job independently. But the independent report does not help us here. So we group the results into one overall result with this parameter.
  • –name
    name of this run/test

IMPORTANT NOTICE

The above command will overwrite your data on the drive! So be careful to take the correct drive, else you operating system or even your data is getting overwritten!

Tests to saturate your fastest drives

Your disks can be so fast that you need multiple tests to max out (saturate) the disks. We can try this with the runtime or with the numjobs parameters.

Test via long running tests

As named already above you need to test different runtimes with –runtime parameter to saturate the caches or drive tunings. Start with 60 seconds and increase it step wise to 120, 180. My tests are often this:

  • 60
    start test
  • 180
    second test
  • 600
    third test

If the 600 seconds test has nearly the same values as the previous tests, you either have already the saturation or we cannot reach itdo not reach a saturation

Test via parallel running jobs

If you have really fast drives, the above named test will not saturate your drive. To saturate the drive we have to run more parallel threads against the drive with the parameter –numjobs. My tactic here is to try first one thread and to get up by one increment.

  • –numjobs=1
  • –numjobs=2
  • –numjobs=3
  • –numjobs=4

Using dd

Sometimes you do not have the fio on you system nor the option to install it. In this case you can use also dd. This is the sample command for our dd tests. First let us generate a random test file and we ensure that the file is synced to disk

sudo dd if=/dev/urandom of=randomtestfile bs=1M count=1024
sudo sync

now lets run the test against our drive

sudo dd if=randomtestfile of=/dev/<yourdrive> bs=4k count=100000 oflag=direct,dsync

Let us dive into the command options:

  • if
    the input file, which is either our test file or the random device
  • of
    the output file, which is either our test file or our drive
  • bs
    this is the block size. With the blocksize we simulate the object size handed over from a client to our OSD.. In our example here, we are submitting 4K objects.
    4k is is probably a worst case scenario. If you know your workload in terms of block size, you can here modify it to your needs
  • count
    here we tell the the dd command how many operations to process
  • oflag
    here we define the IO operations like O_DIRECT and O_DSYNC (details see Performance considerations for journal / metadata disks)

Community driven performance measurings

You can submit your own measurings also here to let other users reduce their work too, which you also have profited yourself. So please share your details, it costs you only one minute, which helps others to reduce maybe hours of days of senseless analysis.

Step 1 of 4

Your tested drive

Please choose your drive vendor
960 pro (for the Samsung MZ-V6P512)
MZ-V6P512 (for the Samsung 960pro with 512GB of capacity)
please enter here the drive capacity in GB
The firmware version of your drive
Drive vendorDrive vendor (not listed above)Drive market model nameDrive model codeDrive capaacity in (GB)Device connection typeDevice connection type (not listed above)Drive firmware versionBandwidth: 1 threadIOPS: 1 threadBandwidth: 5 threadsIOPS: 5 threadsBandwidth: 10 threadsIOPS: 10 threadscommands executed for your testresults got from the above commandNotes / Hints to share to the community
HPtcsgroupqLas Vegasother736053045680351424703312563486170751863284847170788185767117671642Palmitoyl tripeptide-5 triflate is a component of cell transduction, and promotes the production of collagen. It is commonly used in anti-aging and anti-wrinkle cosmetics.Palmitoyl tripeptide-5 triflate is a component of cell transduction, and promotes the production of collagen. It is commonly used in anti-aging and anti-wrinkle cosmetics.
MediaRangedrypoldBdAvaruaother001360867765631363050185878267362860633315352002606020515732170230Qojdkn https://newfasttadalafil.com/ - Cialis Zbtpuz 20 Mg Cialis Side Effects Aldwxe buy cialis online in usa Levitra Versand Online Ybrtuy https://newfasttadalafil.com/ - CialisQojdkn https://newfasttadalafil.com/ - Cialis Zbtpuz 20 Mg Cialis Side Effects Aldwxe buy cialis online in usa Levitra Versand Online Ybrtuy https://newfasttadalafil.com/ - Cialis
HPtcsgroupxLong Beachother883211216616075845532411241166525054222268826808026541148125604202dalbavancin (inn, trade names dalvance in the us and xydalba in the eu) is a novel second-generation lipoglycopeptide antibiotic medication. it belongs to the same class as vancomycin, the most widely used and one of the few treatments available to patients infected with methicillin-resistant staphylococcus aureus (mrsa). dalbavancin is a semisynthetic lipoglycopeptide that was designed to improve upon the natural glycopeptides currently available, vancomycin and teicoplanin..it is derived from a complex of glycopeptide antibiotics, referred to as a-40926, that is produced by a new strain of actinomadura. dalbavancin has been referred to in the scientific literature by a series of names: mdl-63397, a-!-1, bi-397, ver-001. these different labels reflected where the research had been carried out: mdl representing merrell-dow-lepetit, where the initial complex was discovered; bi referring to biosearch italia where dalbavancin itself was first synthesized; ver referring to versicor (which biosearch italia merged with to create vicuron pharmaceuticals). the phase 1, 2 and 3 clinical trials were carried out of by vicuron and the initial nda filed. vicuron was acquired by pfizer in 2005, which decided to not further develop dalbavancin at that time, subsequently selling the rights to durata therapeutics in 2009. it possesses in vitro activity against a variety of gram-positive pathogens including mrsa and methicillin-resistant staphylococcus epidermidis (mrse). it is a once-weekly, two-dose antibiotic, the rights to which actavis acquired when it bought durata therapeutics in 2014. the u.s. food and drug administration (fda) approved dalbavancin in may 2014, for the treatment of acute bacterial skin and skin structure infections (absssis) caused by certain susceptible bacteria such as staphylococcus aureus including methicillin-susceptible and methicillin-resistant strains of streptococcus pyogenes, in intravenous dosage form.dalbavancin (inn, trade names dalvance in the us and xydalba in the eu) is a novel second-generation lipoglycopeptide antibiotic medication. it belongs to the same class as vancomycin, the most widely used and one of the few treatments available to patients infected with methicillin-resistant staphylococcus aureus (mrsa). dalbavancin is a semisynthetic lipoglycopeptide that was designed to improve upon the natural glycopeptides currently available, vancomycin and teicoplanin..it is derived from a complex of glycopeptide antibiotics, referred to as a-40926, that is produced by a new strain of actinomadura. dalbavancin has been referred to in the scientific literature by a series of names: mdl-63397, a-!-1, bi-397, ver-001. these different labels reflected where the research had been carried out: mdl representing merrell-dow-lepetit, where the initial complex was discovered; bi referring to biosearch italia where dalbavancin itself was first synthesized; ver referring to versicor (which biosearch italia merged with to create vicuron pharmaceuticals). the phase 1, 2 and 3 clinical trials were carried out of by vicuron and the initial nda filed. vicuron was acquired by pfizer in 2005, which decided to not further develop dalbavancin at that time, subsequently selling the rights to durata therapeutics in 2009. it possesses in vitro activity against a variety of gram-positive pathogens including mrsa and methicillin-resistant staphylococcus epidermidis (mrse). it is a once-weekly, two-dose antibiotic, the rights to which actavis acquired when it bought durata therapeutics in 2014. the u.s. food and drug administration (fda) approved dalbavancin in may 2014, for the treatment of acute bacterial skin and skin structure infections (absssis) caused by certain susceptible bacteria such as staphylococcus aureus including methicillin-susceptible and methicillin-resistant strains of streptococcus pyogenes, in intravenous dosage form.
AngelbirdtcsindustryzSan Joseother826063002036314301552072723230445387868588753484141285750361360146chlorambucil, sold under the brand name leukeran among others, is a chemotherapy medication used to treat chronic lymphocytic leukemia (cll), hodgkin lymphoma, and non-hodgkin lymphoma. for cll it is a preferred treatment. it is given by mouth. common side effects include bone marrow suppression. other serious side effects include an increased long term risk of further cancer, infertility, and allergic reactions. use during pregnancy often results in harm to the baby. chlorambucil is in the alkylating agent family of medications. it works by blocking the formation of dna and rna. chlorambucil was approved for medical use in the united states in 1957. it is on the world health organization's list of essential medicines, the safest and most effective medicines needed in a health system. it was originally made from nitrogen mustard. medical uses chlorambucil's current use is mainly in chronic lymphocytic leukemia, as it is well tolerated by most patients, though chlorambucil has been largely replaced by fludarabine as first-line treatment in younger patients. it can be used for treating some types of non-hodgkin lymphoma, waldenstr?m macroglobulinemia, polycythemia vera, trophoblastic neoplasms, and ovarian carcinoma. moreover, it also has been used as an immunosuppressive drug for various autoimmune and inflammatory conditions, such as nephrotic syndrome. side effects bone marrow suppression (anemia, neutropenia, thrombocytopenia) is the most commonly occurring side effect of chlorambucil. withdrawn from the drug, this side effect is typically reversible. like many alkylating agents, chlorambucil has been associated with the development of other forms of cancer. less commonly occurring side effects include: gastrointestinal distress (nausea, vomiting, diarrhea, and oral ulcerations). central nervous system: seizures, tremors, muscular twitching, confusion, agitation, ataxia, and hallucinations. skin reactions hepatotoxicity infertility hair losschlorambucil, sold under the brand name leukeran among others, is a chemotherapy medication used to treat chronic lymphocytic leukemia (cll), hodgkin lymphoma, and non-hodgkin lymphoma. for cll it is a preferred treatment. it is given by mouth. common side effects include bone marrow suppression. other serious side effects include an increased long term risk of further cancer, infertility, and allergic reactions. use during pregnancy often results in harm to the baby. chlorambucil is in the alkylating agent family of medications. it works by blocking the formation of dna and rna. chlorambucil was approved for medical use in the united states in 1957. it is on the world health organization's list of essential medicines, the safest and most effective medicines needed in a health system. it was originally made from nitrogen mustard. medical uses chlorambucil's current use is mainly in chronic lymphocytic leukemia, as it is well tolerated by most patients, though chlorambucil has been largely replaced by fludarabine as first-line treatment in younger patients. it can be used for treating some types of non-hodgkin lymphoma, waldenstr?m macroglobulinemia, polycythemia vera, trophoblastic neoplasms, and ovarian carcinoma. moreover, it also has been used as an immunosuppressive drug for various autoimmune and inflammatory conditions, such as nephrotic syndrome. side effects bone marrow suppression (anemia, neutropenia, thrombocytopenia) is the most commonly occurring side effect of chlorambucil. withdrawn from the drug, this side effect is typically reversible. like many alkylating agents, chlorambucil has been associated with the development of other forms of cancer. less commonly occurring side effects include: gastrointestinal distress (nausea, vomiting, diarrhea, and oral ulcerations). central nervous system: seizures, tremors, muscular twitching, confusion, agitation, ataxia, and hallucinations. skin reactions hepatotoxicity infertility hair loss
MediaRangeenquicyBYAvaruaother678783686342424540540343326850677471031705873572681322284374213434Yyxkkw Is Cephalexin Safe For Pregnant Dogs https://bestadalafil.com/ - Cialis Amzqmf cialis sur le net Rcetha tadalafil penis size Cialis Mauagk https://bestadalafil.com/ - generic cialis 20mg Nmjdbg cialis en prise quotidienneYyxkkw Is Cephalexin Safe For Pregnant Dogs https://bestadalafil.com/ - Cialis Amzqmf cialis sur le net Rcetha tadalafil penis size Cialis Mauagk https://bestadalafil.com/ - generic cialis 20mg Nmjdbg cialis en prise quotidienne
DelkintcsindustrytOaklandother604022132176540473260004518778244000787141473660113723664618021340oritavancin, sold under the brand name orbactiv, is a novel semisynthetic glycopeptide antibiotic medication for the treatment of serious gram-positive bacterial infections. its chemical structure as a lipoglycopeptide is similar to vancomycin. the u.s. food and drug administration (fda) and the european medicines agency (ema) have approved oritavancin for treatment of acute bacterial skin and skin structure infections. in vitro activity oritavancin shares certain properties with other members of the glycopeptide class of antibiotics, which includes vancomycin, the current standard of care for serious gram-positive infections in the united states and europe. it possesses potent and rapid bactericidal activity in vitro against a broad spectrum of both resistant and susceptible gram-positive bacteria, including staphylococcus aureus, mrsa, enterococci, and streptococci. oritavancin was more active than either metronidazole or vancomycin against strains of clostridium difficile tested. oritavancin has potential use as a therapy for exposure to bacillus anthracis, the gram-positive bacterium that causes anthrax, having demonstrated efficacy in a mouse model both before and after exposure to the bacterium. mechanism the 4'-chlorobiphenylmethyl group disrupts the cell membrane of gram-positive bacteria. it also acts by inhibition of transglycosylation and inhibition of transpeptidation.oritavancin, sold under the brand name orbactiv, is a novel semisynthetic glycopeptide antibiotic medication for the treatment of serious gram-positive bacterial infections. its chemical structure as a lipoglycopeptide is similar to vancomycin. the u.s. food and drug administration (fda) and the european medicines agency (ema) have approved oritavancin for treatment of acute bacterial skin and skin structure infections. in vitro activity oritavancin shares certain properties with other members of the glycopeptide class of antibiotics, which includes vancomycin, the current standard of care for serious gram-positive infections in the united states and europe. it possesses potent and rapid bactericidal activity in vitro against a broad spectrum of both resistant and susceptible gram-positive bacteria, including staphylococcus aureus, mrsa, enterococci, and streptococci. oritavancin was more active than either metronidazole or vancomycin against strains of clostridium difficile tested. oritavancin has potential use as a therapy for exposure to bacillus anthracis, the gram-positive bacterium that causes anthrax, having demonstrated efficacy in a mouse model both before and after exposure to the bacterium. mechanism the 4'-chlorobiphenylmethyl group disrupts the cell membrane of gram-positive bacteria. it also acts by inhibition of transglycosylation and inhibition of transpeptidation.
IntensoKevinFangeDPKwajaleinother151775382421853575550150855203481605786442464240488364425121658458Was sind last resting-place besten Gewinnchancen in einem Casino? "Einarmige Banditen" Einarmige Banditen Casinos werden in erster Linie mit Roulette und Poker in Verbindung gebracht, aber Statistiken zeigen, dass 61 % der Besucher von Spielhallen ihre Zeit damit verbringen, einarmige Banditen zu spielen (Daten von 2013 von der American Gaming Association). Vanish Regeln der Spielautomaten sind sehr einfach, und der niedrige Mindesteinsatz macht sie auch fur join the majority armsten Spieler zuganglich. http://dolce-vita.com/wp-content/pages/welche_kasinos_gewinnen_.html https://ltsv-brandenburg.de/news/was_sind_die_besten_gewinnchancen_in_einem_casino___die_rechtliche_komponente_.html https://omnikon.de/pag/was_sind_die_besten_gewinnchancen_in_einem_casino__werden_wir_von_casinos_betrogen_.html http://gsv-moers.de/wp-content/pages/casino_gewinne_1.html http://fckonzenberg.de/includes/pgs/was_sind_die_besten_gewinnchancen_in_einem_casino___kasino_mathematik_.htmlWas sind last resting-place besten Gewinnchancen in einem Casino? "Einarmige Banditen" Einarmige Banditen Casinos werden in erster Linie mit Roulette und Poker in Verbindung gebracht, aber Statistiken zeigen, dass 61 % der Besucher von Spielhallen ihre Zeit damit verbringen, einarmige Banditen zu spielen (Daten von 2013 von der American Gaming Association). Vanish Regeln der Spielautomaten sind sehr einfach, und der niedrige Mindesteinsatz macht sie auch fur join the majority armsten Spieler zuganglich. http://dolce-vita.com/wp-content/pages/welche_kasinos_gewinnen_.html https://ltsv-brandenburg.de/news/was_sind_die_besten_gewinnchancen_in_einem_casino___die_rechtliche_komponente_.html https://omnikon.de/pag/was_sind_die_besten_gewinnchancen_in_einem_casino__werden_wir_von_casinos_betrogen_.html http://gsv-moers.de/wp-content/pages/casino_gewinne_1.html http://fckonzenberg.de/includes/pgs/was_sind_die_besten_gewinnchancen_in_einem_casino___kasino_mathematik_.html
othertesttesttest1024othertesttest111111111111111111111111testtesttest
othertesttesttest1024othertesttest111111111111111111111111testtesttest
othertest vendorasdfasdfadsf128m.2 SATA 3 (NGFF)1235005121000102420002048testatestetest
othertest vendorasdfasdfadsf128m.2 SATA 3 (NGFF)1235005121000102420002048testatestetest