|
|
|
This page mirrors information from the Official Optimark Page.
Introduction
Optimark is a benchmarking tool for still image watermarking algorithms that was developed in the Artificial Intelligence and Information Analysis Laboratory at the Department of Informatics, Aristotle University of Thessaloniki, Greece. Its main features can be summarized as follows:
- Graphical user interface.
- Detection/decoding performance evaluation using multiple trials utilizing different watermaking keys and messages.
- Evaluation of the following detection performance metrics:
- For watermark detectors that provide a float output, i.e., the value of the test statistic used for detection:
- Receiver Operating Characteristic curves (ROC), i.e. plots of the probability of false alarm versus the probability of false rejection.
- Equal Error Rate.
- Probability of false alarm for a fixed, user defined, probability of false rejection.
- Probability of false rejection for a fixed, user defined, probability of false alarm.
- For watermark detectors that provide a binary output, i.e. a value that states whether the watermark has been detected or not:
- Probabilities of false alarm and false rejection.
- Evaluation of the following decoding performance metrics, for algorithms that allow for message encoding (multiple bit algorithms):
- Bit error rate.
- Percentage (probability) of perfectly decoded messages.
- Evaluation of the mean embedding and detection time.
- Evaluation of the algorithm payload (for multiple bit algorithms).
- Evaluation of the algorithm breakdown limit for a certain attack and a certain performance criterion, i.e., evaluation of the attack severity where algorithm performance exceeds (or falls below) a certain limit.
- Result summarization in multiple levels using a set of user defined weights on the selected attacks and images.
- Option for both user defined and preset benchmarking sessions.
Optimark was partially supported by EU Projects CERTIMARK & INSPECT
Attacks
Optimark includes the following attacks:
- No Attack
- Cropping
- Line and Column Removal
- General Linear Transformation
- Scaling
- Shearing
- Horizontal Flip
- Rotation
- Rotation + Autocropping
- Rotation + Autocropping + Autoscale
- Sharpening
- Gaussian Filtering
- Median
- Jpeg
Links
|
