API
If you're looking for an API, you can choose from your desired programming language.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
import requests
import base64
# Use this function to convert an image file from the filesystem to base64
def image_file_to_base64(image_path):
with open(image_path, 'rb') as f:
image_data = f.read()
return base64.b64encode(image_data).decode('utf-8')
# Use this function to fetch an image from a URL and convert it to base64
def image_url_to_base64(image_url):
response = requests.get(image_url)
image_data = response.content
return base64.b64encode(image_data).decode('utf-8')
api_key = "YOUR_API_KEY"
url = "https://api.segmind.com/v1/tinysd1.5-txt2img"
# Request payload
data = {
"prompt": "cyborg in a battlefield, explosions, highly detailed",
"negative_prompt": "(deformed iris, deformed pupils, semi-realistic, cgi, render, sketch, cartoon, drawing, anime), text, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck, BadDream, UnrealisticDream",
"scheduler": "dpmpp_2m",
"num_inference_steps": 100,
"guidance_scale": 7.5,
"samples": 1,
"seed": 2313248373,
"img_width": 512,
"img_height": 512,
"base64": False
}
headers = {'x-api-key': api_key}
response = requests.post(url, json=data, headers=headers)
print(response.content) # The response is the generated imageAttributes
Prompt to render
Prompts to exclude, eg. 'bad anatomy, bad hands, missing fingers'
Type of scheduler.
Allowed values:
Number of denoising steps.
min : 20,
max : 100
Scale for classifier-free guidance
min : 0.1,
max : 25
Number of samples to generate.
min : 1,
max : 4
Seed for image generation.
Width of the image.
Allowed values:
Height of the Image
Allowed values:
Base64 encoding of the output image.
To keep track of your credit usage, you can inspect the response headers of each API call. The x-remaining-credits property will indicate the number of remaining credits in your account. Ensure you monitor this value to avoid any disruptions in your API usage.
PixelFlow allows you to use all these features
Unlock the full potential of generative AI with Segmind. Create stunning visuals and innovative designs with total creative control. Take advantage of powerful development tools to automate processes and models, elevating your creative workflow.
Segmented Creation Workflow
Gain greater control by dividing the creative process into distinct steps, refining each phase.
Customized Output
Customize at various stages, from initial generation to final adjustments, ensuring tailored creative outputs.
Layering Different Models
Integrate and utilize multiple models simultaneously, producing complex and polished creative results.
Workflow APIs
Deploy Pixelflows as APIs quickly, without server setup, ensuring scalability and efficiency.
Segmind Tiny-SD: A Faster, More Efficient Text-to-Image Model
Meet Segmind Tiny-SD, a breakthrough product by Segmind that is pushing the boundaries of generative AI models. As part of Segmind's ongoing commitment to making AI more accessible, we have released this new compact and accelerated Stable Diffusion model, which is open-sourced on Huggingface. Following the innovative research from the paper "On Architectural Compression of Text-to-Image Diffusion Models", Segmind has refined the idea and introduced two compact models: SD-Small and SD-Tiny. Each model exhibits a reduction in parameters while maintaining comparable image fidelity, with SD-Tiny achieving a reduction of 55% compared to the base model.
The technical architecture of Segmind Tiny-SD revolves around the concept of Knowledge Distillation (KD), akin to a teacher-student relationship in the world of AI. An expansive, pre-trained model (the teacher) guides a smaller model (the student) through the process of training on a smaller dataset. The unique aspect of this architecture is the incorporation of block-level output matching from the teacher model, which enables preservation of the model quality while reducing its size. The KD process involves a multi-component loss function that considers the traditional loss, the loss between the teacher and student generated latents, and importantly, the feature-level loss - the discrepancy between the block outputs of the teacher and student models.
The significant advantage of the Segmind Tiny-SD model lies in its speed and efficiency. With up to 85% faster inferences, these models are designed to drastically slash the time needed to generate results, delivering both superior performance and cost-effectiveness. The reduced size does not compromise the quality of the images, making this an ideal solution for tasks requiring high-quality image generation at a faster pace.
Segmind Tiny-SD use cases
-
Content Generation: Quick generation of high-quality images for digital content like blogs, social media posts, and more.
-
Game Development: Efficient and creative generation of unique game assets for independent and AAA game developers.
-
Personalized Marketing: Faster generation of personalized visual content for digital marketing campaigns, enhancing customer engagement.
-
AI Art and Design: Artists and designers can use it to create unique, AI-assisted visual content in less time.
-
Research and Development: In various AI research domains, quick inference can accelerate experimentation, enabling faster progress and discovery.
Segmind Tiny-SD License
Segmind Tiny-SD is licensed under CreativeML Open RAIL-M. This license encourages both the open and responsible use of the model. It is inspired by permissive open-source licenses in terms of granting IP rights while also adding use-based restrictions to prevent misuse of the technology, be it due to technical limitations or ethical considerations. While derivative versions of the model can be released under different licensing terms, they must always include the same use-based restrictions as the original license. Thus, the license strikes a balance between open and responsible AI development, promoting open-science in the field of AI while simultaneously addressing potential misuse.
Other Popular Models
sdxl-img2img
SDXL Img2Img is used for text-guided image-to-image translation. This model uses the weights from Stable Diffusion to generate new images from an input image using StableDiffusionImg2ImgPipeline from diffusers
idm-vton
Best-in-class clothing virtual try on in the wild
insta-depth
InstantID aims to generate customized images with various poses or styles from only a single reference ID image while ensuring high fidelity
sdxl1.0-txt2img
The SDXL model is the official upgrade to the v1.5 model. The model is released as open-source software
