WordPress 4.4 responsive sometimes doesn’t work

Got it working by removing the <a href> from the image. This is the proper way of doing a responsive image with a link:

<a href="https://wordpress.stackexchange.com/questions/212844/<?php the_permalink(); ?>">
<picture>
<source srcset="https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/<?php echo get_template_directory_uri(); ?>/img/noimg-499px" media="(max-width: 599px)">
<source srcset="https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/<?php echo get_template_directory_uri(); ?>/img/noimg-120x90.jpg" media="(max-width: 767px)">
<source srcset="https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/<?php echo get_template_directory_uri(); ?>/img/noimg-220x116.jpg">
<!-- fallback -->
<img srcset="https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/https://wordpress.stackexchange.com/<?php echo get_template_directory_uri(); ?>/img/noimg-220x116.jpg" alt="alt text">
</picture>
</a>