Comet - Licensing only

My main use case for Comet  is experiment tracking and model lifecycle management. Comet  has been a very helpful tool in our machine learning workflows. It has helped us improve reproducibility, collaboration, and visibility across all the AI projects that we manage. My primary use case is experiment tracking and machine learning.

Initially, we needed Comet as a centralized platform because we required a centralized platform that could track experiments and improve collaboration between the ML engineers and the data scientists. Comet has allowed us to consolidate experiment tracking and visualization into a single platform, making our workflow much more organized and reproducible.

Comet allowed us to consolidate experiment management, model evaluation, and visualization, everything into a single platform, which made our ML workflows much more organized and reproducible.

The most important use case of Comet would be the centralized experiment tracking. Every training run, metric, hyperparameter configuration, and model outputs are logged automatically, which makes it much easier to compare experiments and identify what is improving model performance.

The most important feature that Comet offers would be the reproducibility. Previously, we had to reproduce old experiments by ourselves, which was difficult because configuration metrics and everything else was scattered across notebooks and local systems. When we introduced Comet into our systems, all our experiments are stored in a single place, which greatly simplifies debugging and retraining workflows. Visualization is another feature that provides clear dashboards for tracking and resource utilization.

Visibility is the main benefit of Comet that has helped us create dashboards for tracking multiple models across various domains. Training curves, validation metrics, and resource utilization at different levels are all visible. This visibility has made it easier for us to understand where we are getting overfitting or where we are facing bottlenecks. Collaboration is also improved. Engineers can sit down and share findings within a single environment instead of relying on spreadsheets and multiple disconnected notebooks.

Comet has good integration capabilities with popular ML frameworks, and the integration is very strong. While using some customized pipelines, we need to have some manual configuration, and some effort is needed in that area. Apart from that, Comet is a very capable platform for ML lifecycle management.

Comet is a very powerful tool for experiment tracking and MLOps workflows, but the platform is somewhat complex for teams that are not initially familiar with the structured practices that have to be followed in MLOps. Understanding experiment organization, integrations, and tracking workflows requires some onboarding.

Pricing is one of the major challenges that Comet is facing. As our organization has increased and many users and experiment tracking requirements have increased, the platform cost can increase very quickly. The platform delivers very strong value when the users have increased or experiment tracking has increased extensively. However, as the ML workload increases, the cost also increases very quickly. Smaller teams running a limited number of ML experiments may not be able to fully utilize its capabilities as a whole.

Comet has good integration capabilities with popular ML frameworks, and the integration is very strong. While using some customized pipelines, we need to have some manual configuration, and some effort is needed in that area. The slight learning curve for teams that are unfamiliar with structured MLOps practices could have some improvement in that area. Some integrations with customized pipelines still require a lot of manual effort, which is one area that Comet could improve in.

Pricing initially seemed very high compared to other open-source experiment tracking tools. However, once we integrated the platform into our workflows, the productivity improvements justified the investment.

I have been using Comet for around nine months.

Comet is very stable and easily scalable. Comet has been very stable in our experience, and with experiment logging, dashboard visualization, and model tracking workflows, it performs reliably even during large training workloads. We have not experienced any reliability issues affecting our ML operations. The performance platform handles scaling well as the number of experiments and users increases.

The scalability of Comet is a very strong point for its use case. As we have scaled across multiple experiments, our models have increased by two to three folds. Comet is continuously able to organize runs efficiently and maintain visibility across projects, which becomes very important when we are scaling as an AI team.

Comet has been very stable in our experience, and with experiment logging, dashboard visualization, and model tracking workflows, it performs reliably even during large training workloads. We have not experienced any reliability issues affecting our ML operations. The performance platform handles scaling well as the number of experiments and users increases. The number of experiment models has increased drastically, but Comet has continued to organize runs efficiently and maintain visibility across multiple projects.

Our overall experience with customer support has been mostly positive. Documentation has been quite detailed, and integration with PyTorch  and TensorFlow  are generally very straightforward. For advanced configurations, our support interactions were very responsive and technically helpful. I would rate the customer support a nine out of ten.

Initially, we managed all our experiments manually using Jupyter notebooks, spreadsheets, TensorBoard, and some internally managed tracking scripts before switching to Comet. We thought switching would allow us to manage experiments across multiple tools easily, which had become very inefficient with the previous solutions we were using, making reproducibility very difficult. Comet provided a centralized and much more scalable alternative for experimentation altogether.

The setup process was very straightforward, especially for teams already using modern ML frameworks, and even integration with our existing training pipelines was very smooth.

The biggest return on investment of Comet comes from improved reproducibility. We have improved reproducibility and experimentation has been way faster than before, and collaboration between teams has gotten better. This has allowed us to cut our workforce that was redundant, basically doing the manual documentation work, which has now shifted to Comet. Development lifecycles have become about one point five times faster. We spend less time debugging, and more time is spent tracking model performance and documenting experiments, which has shifted to actual model developments and overall metrics improvements. This has been our main return on investment.

Before choosing Comet, we evaluated MLflow, Weights & Biases, Neptune.ai, and TensorBoard. Most of these solutions handled parts of experiment tracking, but Comet stood out because it allowed us to have visualization along with centralized experiment management, which served as a base for great collaboration. That clear dashboard and strong visualization capabilities are what led us to choose Comet.

My advice for others looking into using Comet would be to evaluate the scale and level that their organization operates at. If a team is running occasional ML experiments with a smaller number of researchers, lightweight tracking tools may be sufficient. However, for organizations managing multiple models and datasets, Comet provides a great load of benefits for them. The platform is very valuable when reproducibility, centralized visibility, and experiment comparison become important priorities. For AI-focused organizations or ML teams starting to scale, I would definitely recommend Comet.

Comet is a very valuable platform when it comes to reproducibility, collaboration, experiment tracking, and visibility. Even though there is a slight initial learning curve for teams trying to use Comet, once you are familiar with it and once your workflows and integrations are sorted, Comet becomes a very powerful platform for managing all your ML experimentation. I believe this review is overall quite good and would help anyone understand whether Comet is built for their team or if they would require it. I give this review an overall rating of eight out of ten.

My main use case for Comet  is to work with agentic behavior, demonstrating how my web browser can be integrated seamlessly. I utilize it to build my browser within the chat, allowing me to ask questions related to web pages or PDFs, summarize web documents, and provide explanations. Additionally, I am building task automation capabilities, such as opening websites with click buttons or filling forms to automate my work. I have utilized it on many shopping platforms for booking tickets, sending cold emails and hot emails to different clients, and conducting research work related to my projects focused on trending technologies in AI to summarize blogs using Comet  browser. My productivity has increased, my familiarity with multiple technologies has improved, and I can work faster to integrate different tools like email, calendar, and multiple browser tabs, resulting in a smoother context for memorization.

One specific example where I used Comet for task automation involved generating an automated dataset research within feature extraction of kidney patient data from around the globe for my particular use case. I needed to identify how kidney patients' data on different parameters like creatinine, glucose, and diabetes correlates. If I had done that manually, it would have taken around three to four hours or even a whole day to research different products, gather the data, scrape the particular filters, and conduct multisourcing. By utilizing Comet, it auto-reads all the inputs I am looking for, understands what kind of data inputs I am seeking, and automates the entire web research process more efficiently to provide navigation or a downloadable option for the complete dataset. This is how I implemented automated research on the dataset, leading to the creation of a generation pipeline that helps identify any document of data to download and utilize in my AI work.

At this point, I have nothing else to add about my main use case with Comet, but I can mention several unique features I have experienced with the web browser itself, where I have worked on searching, reading, summarizing, and fixing bugs directly in the browser. Automation processes are continuous, allowing for better results.

Comet's best features include its smart response system that acts intelligently on whatever questions are asked and conducts global research on the browser. It serves as a personal assistant for users, focusing on how searches, specific data targets, calendar functionalities, Gmail activities, preferred languages, and relevant searches function within Comet. This setup significantly reduces task efficiency in high latency scenarios, providing dynamic websites, faster responses, quicker solutions, and smoother searches compared to typical browsing methods. It serves as an AI assistant or personal assistant for the browser, understanding context on web pages and delivering correct solutions, summaries, and explanations. Additionally, I can effectively engage in shopping by identifying booking options, comparing multiple platforms for cheaper prices, and obtaining ticket bookings and train bookings, all through the browser instead of searching through numerous platforms.

Comet's smart researching and the ability to find cheaper prices in shopping and ticket booking are the features I personally find most useful in my day-to-day work, making my tasks easier and more efficient. Comet excels in web browser functionalities, particularly as an AI web browser.

As an AI tech lead, I have experienced positive impacts from Comet in my organization by facilitating many client researches related to LLM, AI, and agentic automations. Comet behaves effectively in researching different platforms such as LinkedIn, Kaggle, Indeed, Naukri.com, and even other tools such as Malt for identifying potential clients suitable for our projects and tasks.

I have identified some areas for improvement in Comet, particularly regarding high-quality prompting for AI questions. If Comet behaves similarly to Chrome, there is minimal benefit to using Comet over traditional browsers. Comet needs smarter algorithms to understand user inquiries and provide better reasoning steps. Enhancing decision-making reliability would improve context comprehension, which currently falters in long sessions, breaking down agentic flows.

I have been working in my current field for around six years.

Comet is stable.

Comet's scalability is excellent, as it can generate customized user-to-user browsers and offers team-level based subscriptions of the AI browser.

Comet's customer support is good enough; I can reach out to them for any inquiries about policies and security, and they respond quickly with appropriate solutions. Comet's help center contributes significantly to building the AI-powered solution smoothly and rapidly.

Comet is my first experience using any AI-based browser.

I purchased Comet externally rather than through the AWS  marketplace.

Comet's return on investment is evident through significant time reduction, which is the most crucial factor I have observed.

My experience with Comet's pricing, setup cost, and licensing has been smooth without major issues, and I found it easy to understand the pricing and subscription models for faster integration.

Given that this is my first experience, I have not evaluated other options.

I advise others looking into using Comet to opt for the AI-assisted browser mechanism instead of conventional browsers, allowing them to customize solutions for research, product delivery, shopping, ticket booking, scheduling emails, and more. Automation made possible through Comet is very effective, and I recommend it highly for those considering switching to an AI-based browser. I am providing this review with a rating of 9.