Validating values using Settings API?

No, you don’t need to validate/clean/escape because of security flaws in wordpress. WordPress use prepared statements by default.

However, you can validate by yourself that the content is what you expecting. For example if you only want numbers you can use is_numeric() or is_float(). Or match the input value to an array of predefined strings.