Speckle AI - Generative AI Renderings

Hey @Pierre_aymeric_Masse ,

Welcome to the community! Feel free to Introduce yourself :person_gesturing_ok: to the community if you want to! :grinning_face:

This sounds like a cool idea! To answer your questions:

Yes, it is possible. As a proof of concept, you can try to use our comments functionality to hack it. Comments/discussions also store a screenshot of the comment view. You can create a webhook that gets triggered when a comment is added and its content contains the word “/imagine” similar to Midjourney😉. Then you can get the comment screenshot and use that for the rendering.

I did something similar a couple of years ago to get a screenshot of a comment. Beware that code might be changed since then.

def get_comments(stream):
        query = gql(
            """{
            comments(streamId:\""""
            + stream.id + 
            """\") {
                items {
                text
                id
                authorId
                createdAt
                data
                resources{
                    resourceId
                }
                archived
                screenshot
                }
            }
            }"""
        )
        # Making query to Speckle
        comments = client.execute_query(query=query)
        return comments

https://github.com/bimgeek/speckle-hackathon-notion/blob/1c34cbd48803e6749b28096809b551890c37eb21/main.py#L188C23-L188C23

I’ll leave the stage to the viewer wizard @alex and @dimitrie to share their expert opinion on this.

I think there are already models out there that are pretty good for doing archviz ai work. Can’t you directly use those?

I hope this helps. Please share your updates on this.