SDROC Estimate ROC of a classifier R=SDROC(TS,P) % provide test set and trained classifier R=SDROC(OUT) % provide soft outputs out=ts*-p R2=SDROC(R,OUT) % re-estimate from OUT using op.points in R INPUT TS test set P trained classifier pipeline OUT data set with classifier soft outputs OUTPUT R,R2 SDROC objects OPTIONS 'target' Name of the target decision 'non-target' Name of the non-target decision in the resulting op.point. 'reject' Add a reject option and construct reject curve. - if (0,1) fraction is given, set threshold by rejecting percentage of all samples - if SDOPS or SDROC is given, use current op.point 'measures' Cell array with measure names and parameters. 'noconfmat' - Do not store confusion matrices ('confmat' option is used by default) 'polarity',P - Set polarity of the soft output (P is 'similarity' or 'distance') 'maxpoints',M - Set maximum number of operating point (2000 by default) DESCRIPTION SDROC performs ROC analysis of classifier P on the test set TS. Alternatively, soft output set OUT can be provided. SDROC performs two- or multi- class analysis using output thresholding or weighting. The output is an object with estimated measures as a set of operating points. ROC can be visualized using interactive SDDRAWROC plot. Operating points can be selected using SETCUROP or CONSTRAIN. EXAMPLES Estimate from test set and trained classifier: p=sdparzen(tr) r=sdroc(ts,p) Estimate from soft outputs out=ts*-p % -p removes decision step so that out is sddata with soft outputs r=sdroc(out) Specifying the performance measures to estimate: r=sdroc(ts,p,'measures',{'FPr','apple','TPr','apple'}) r=sdroc(ts,p,'measures',{'custom:F',@custom_F_measure}) % custom measure SEE ALSO CUSTOM_F_MEASURE, SETCUROP