xinran—yulei



Yarbus’s classic eye-tracking experiment demonstrated that different viewing tasks and question framings direct observers’ attention to different regions of the same image, resulting in markedly different visual scanpaths.





The keywords of the novel text match the fragments of the painting.

The generated 3D model

Match results

Model generation

Virtual reality viewing trajectory of the venue

Site thermal vision analysis

matched the datasets

Design Site selection

This paper discusses visual saliency analysis - we trained the SOM based on visual attractiveness features.

som（film and airbnb）

This example links the real photos of Airbnb from the two pictures with the dataset of movie scenes.

Artwork data:

1,000 paintings of windows were crawled from multiple websites such as CMA, Wikiart, and Met.

Film

collected from Panoramas of Cinema

Novel

From 3544 Dutch novels, 1000 story segments strongly related to windows

from two website：

gutenberg project

National Library of the Netherlands (KB).

Airbnb

Theoretical Framework

1.Site Model Processing ( Finish )

2.Site Matching ( Finish )

3.Transforming painting fragments into 3D (subsequently creating abstract forms using depth maps)

One approach involves reimagining the rooms behind facades through a voyeuristic lens and presenting them to the public: conducting VR line-of-sight scans of Rotterdam’s actual building facades, recording how long contemporary passersby gaze at each window. Windows where gaze duration exceeds a certain threshold are deemed "activated." Each activated window is then take over by a cluster of Airbnb data corresponding to its geographic coordinates—through cross-modal retrieval, a set of culturally bound signatures (movie frames, painting color palettes, novel excerpts) is assigned to it. The original room behind the window is reimagined: using these signatures, a new small room is generated as a secondary narrative of the story hidden behind that window. These newly infused rooms leave visible traces on the façade detectable by pedestrians, inviting viewers from the street to peer into a museum scattered across the city's real-world buildings.

A window is the oldest public-private apparatus of the city. It dictates who may look in, who may look out, what is put on display, and what is concealed—an entire urban order built around intimacy, etiquette, surveillance and theatrical performance has settled upon this thin sheet of glass over centuries. Dutch urban culture has sharpened this apparatus to an exceptional edge: from the unobscured wide windows of Calvinist "transparency without concealment", to interiors sliced by window light in the canvases of Vermeer and de Hooch, and onward to the red-light district windows rented out for paid spectatorship. The window bears enduring traces of Rotterdam’s perpetual negotiation over the dynamic of seeing and being seen.

Airbnb has torn away this delicate negotiation. Once a room is photographed and uploaded online, the entire interior transforms into an outward-facing screen. The regulation of visibility shifts from architectural elements—curtains, room depth, thresholds, natural light—to image production: framing, artificial lighting, and the choice of whether to post the space online at all. Private domestic spaces are converted into globally viewable paid imagery, upending the boundary between public and private: what lies inside becomes far more exposed than what lies outside.

Matching Guide - Three Colors Correspond to Three Datasets