| OpenMS 2.5.0

IDFileConverter

Converts peptide/protein identification engine file formats.

potential predecessor tools | IDFileConverter | potential successor tools
TPP tools: PeptideProphet, ProteinProphet | TPP tools: ProteinProphet (for conversion from idXML to pepXML)
Sequest protein identification engine

IDFileConverter can be used to convert identification results from external tools/pipelines (like TPP, Sequest, Mascot, OMSSA, X! Tandem) into other (OpenMS-specific) formats. For search engine results, it might be advisable to use the respective TOPP Adapters (e.g. OMSSAAdapter) to avoid the extra conversion step.

The most simple format accepted is '.tsv': A tab separated text file, which contains one or more peptide sequences per line. Each line represents one spectrum, i.e. is stored as a PeptideIdentification with one or more PeptideHits. Lines starting with "#" are ignored by the parser.

Conversion from the TPP file formats pepXML and protXML to OpenMS' idXML is quite comprehensive, to the extent that the original data can be represented in the simpler idXML format.

In contrast, support for converting from idXML to pepXML is limited. The purpose here is simply to create pepXML files containing the relevant information for the use of ProteinProphet. We use the following heuristic: if peptideprophet_analyzed is set, we take the scores from the idXML as is and assume the PeptideHits contain all necessary information. If peptideprophet is not set, we only provide ProteinProphet-compatible results with probability-based scores (i.e. Percolator with PEP score or scores from IDPosteriorErrorProbability). All secondary or non-probability main scores will be written as "search_scores" only.

Support for conversion to/from mzIdentML (.mzid) is still experimental and may lose information.

The xquest.xml format is very specific to Protein-Protein Cross-Linking MS (XL-MS) applications and is only considered useful for compatibility of OpenPepXL / OpenPepXLLF with the xQuest / xProphet / xTract pipeline. It will only have useful output when converting from idXML or mzid containg XL-MS data.

Details on additional parameters:

`mz_file:`
Some search engine output files (like pepXML, mascotXML, Sequest .out files) may not contain retention times, only scan numbers or spectrum IDs. To be able to look up the actual RT values, the raw file has to be provided using the parameter `mz_file`. (If the identification results should be used later to annotate feature maps or consensus maps, it is critical that they contain RT values. See also IDMapper.)

`mz_name:`
pepXML files can contain results from multiple experiments. However, the idXML format does not support this. The `mz_name` parameter (or `mz_file`, if given) thus serves to define what parts to extract from the pepXML.

`scan_regex:`
This advanced parameter defines a spectrum reference format via a Perl-style regular expression. The reference format connects search hits to the MS2 spectra that were searched, and may be needed to look up e.g. retention times in the raw data (`mz_file`). See the documentation of class SpectrumLookup for details on how to specify spectrum reference formats. Note that it is not necessary to look up any information in the raw data if that information can be extracted directly from the spectrum reference, in which case `mz_file` is not needed.
For Mascot results exported to (Mascot) XML, scan numbers that can be used to look up retention times (via `mz_file`) should be given in the "pep_scan_title" XML elements, but the format can vary. Some default formats are defined in the Mascot XML reader, but if those fail to extract the scan numbers, `scan_regex` can be used to overwrite the defaults.
For pepXML, supplying `scan_regex` may be necessary for files exported from Mascot, but only if the default reference formats (same as for Mascot XML) do not match. The spectrum references to which `scan_regex` is applied are read from the "spectrum" attribute of the "spectrum_query" elements.
For Percolator tab-delimited output, information is extracted from the "PSMId" column. By default, extraction of scan numbers and charge states is supported for MS-GF+ Percolator results (retention times and precursor m/z values can then be looked up in the raw data via `mz_file`).
Some information about the supported input types:

- mzIdentML
- idXML
- pepXML
- protXML
- Mascot XML
- OMSSA XML
- X! Tandem XML
- Sequest .out directory
- Percolator tab-delimited output

The command line parameters of this tool are:

    IDFileConverter -- Converts identification engine file formats.

    Full documentation: http://www.openms.de/documentation/TOPP_IDFileConverter.html

    Version: 2.5.0-GIT-NOTFOUND-GIT-NOTFOUND Sep 10 2020, 12:20:39, Revision: GIT-NOTFOUND

    To cite OpenMS:

      Rost HL, Sachsenberg T, Aiche S, Bielow C et al.. OpenMS: a flexible open-source software platform for mass spectrometry data analysis. Nat Meth. 2016; 13, 9: 741-748. doi:10.1038/nmeth.3959.

    Usage:

      IDFileConverter <options>

    Options (mandatory options marked with '*'):

      -in <path/file>*           Input file or directory containing the data to convert. This may be:

                                 - a single file in a multi-purpose XML format (.pepXML, .protXML, .idXML, .mzid

                                 ),

                                 - a single file in a search engine-specific format (Mascot: .mascotXML, OMSSA:

                                 .omssaXML, X! Tandem: .xml, Percolator: .psms, xQuest: .xquest.xml),

                                 - a single text file (tab separated) with one line for all peptide sequences ma

                                 tching a spectrum (top N hits),

                                 - for Sequest results, a directory containing .out files.

                                 (valid formats: 'pepXML', 'protXML', 'mascotXML', 'omssaXML', 'xml', 'psms', '

                                 tsv', 'idXML', 'mzid', 'xquest.xml')

      -out <file>*               Output file (valid formats: 'idXML', 'mzid', 'pepXML', 'FASTA', 'xquest.xml')

      -out_type <type>           Output file type (default: determined from file extension) (valid: 'idXML', 'mzi

                                 d', 'pepXML', 'FASTA', 'xquest.xml')

      -mz_file <file>            [pepXML, Sequest, Mascot, X! Tandem, mzid, Percolator only] Retention times and

                                 native spectrum ids (spectrum_references) will be looked up in this file (valid

                                 formats: 'mzML', 'mzXML', 'mzData')

      -mz_name <file>            [pepXML only] Experiment filename/path (extension will be removed) to match in

                                 the pepXML file ('base_name' attribute). Only necessary if different from 'mz_fi

                                 le'.

      -peptideprophet_analyzed   [pepXML output only] Write output in the format of a PeptideProphet analysis

                                 result. By default a 'raw' pepXML is produced that contains only search engine

                                 results.

      -score_type <choice>       [Percolator only] Which of the Percolator scores to report as 'the' score for a

                                 peptide hit (default: 'qvalue' valid: 'qvalue', 'PEP', 'score')

    Common TOPP options:

      -ini <file>                Use the given TOPP INI file

      -threads <n>               Sets the number of threads allowed to be used by the TOPP tool (default: '1')

      -write_ini <file>          Writes the default configuration file

      --help                     Shows options

      --helphelp                 Shows all options (including advanced)

INI file documentation of this tool:

Legend:
required parameter
advanced parameter
+IDFileConverter Converts identification engine file formats.
version 2.5.0-GIT-NOTFOUND-GIT-NOTFOUND Version of the tool that generated this parameters file.
++1 Instance '1' section for 'IDFileConverter'
in Input file or directory containing the data to convert. This may be:
- a single file in a multi-purpose XML format (.pepXML, .protXML, .idXML, .mzid),
- a single file in a search engine-specific format (Mascot: .mascotXML, OMSSA: .omssaXML, X! Tandem: .xml, Percolator: .psms, xQuest: .xquest.xml),
- a single text file (tab separated) with one line for all peptide sequences matching a spectrum (top N hits),
- for Sequest results, a directory containing .out files.
input file*.pepXML,*.protXML,*.mascotXML,*.omssaXML,*.xml,*.psms,*.tsv,*.idXML,*.mzid,*.xquest.xml
out Output file output file*.idXML,*.mzid,*.pepXML,*.FASTA,*.xquest.xml
out_type Output file type (default: determined from file extension)idXML,mzid,pepXML,FASTA,xquest.xml
mz_file [pepXML, Sequest, Mascot, X! Tandem, mzid, Percolator only] Retention times and native spectrum ids (spectrum_references) will be looked up in this file input file*.mzML,*.mzXML,*.mzData
mz_name [pepXML only] Experiment filename/path (extension will be removed) to match in the pepXML file ('base_name' attribute). Only necessary if different from 'mz_file'.
peptideprophet_analyzed false [pepXML output only] Write output in the format of a PeptideProphet analysis result. By default a 'raw' pepXML is produced that contains only search engine results.true,false
score_type qvalue [Percolator only] Which of the Percolator scores to report as 'the' score for a peptide hit qvalue,PEP,score
ignore_proteins_per_peptide false [Sequest only] Workaround to deal with .out files that contain e.g. "+1" in references column,
but do not list extra references in subsequent lines (try -debug 3 or 4)true,false
scan_regex [Mascot, pepXML, Percolator only] Regular expression used to extract the scan number or retention time. See documentation for details.
no_spectra_data_override false [+mz_file only] Setting this flag will avoid overriding 'spectra_data' in ProteinIdentifications if mz_file is given and 'spectrum_reference's are added/updated. Use only if you are sure it is absolutely the same mz_file as used for identification.true,false
no_spectra_references_override false [+mz_file only] Setting this flag will avoid overriding 'spectrum_reference' in PeptideIdentifications if mz_file is given and a 'spectrum_reference' is already present.true,false
add_ionmatch_annotation 0.0 [+mz_file only] Will annotate the contained identifications with their matches in the given mz_file. Will take quite some while. Match tolerance is .4
log Name of log file (created only when specified)
debug 0 Sets the debug level
threads 1 Sets the number of threads allowed to be used by the TOPP tool
no_progress false Disables progress logging to command line true,false
force false Overwrite tool specific checks.true,false
test false Enables the test mode (needed for internal use only)true,false