How to Build Robust FAQ Chatbot with Controllable Question Generator?. Many unanswerable adversarial questions fool the question answer (QA) system with some plausible answers. Building a robust, frequently asked questions (FAQ) chatbot needs a large amount of diverse adversarial examples. Recent question generation methods are ineffective at generating many high quality and diverse adversarial question answer pairs from unstructured text. We propose the diversity controllable semantically valid adversarial attacker (DCSA), a high quality, diverse, controllable method to generate standard and adversarial samples with a semantic graph. The fluent and semantically generated QA pairs fool our passage retrieval model successfully. After that, we conduct a study on the robustness and generalization of the QA model with generated QA pairs among different domains. We find that the generated data set improves the generalizability of the QA model to the new target domain and the robustness of the QA model to detect unanswerable adversarial questions.


Improving Depth Estimation using Location Information. The ability to accurately estimate depth information is crucial for many autonomous applications to recognize the surrounded environment and predict the depth of important objects. One of the most recently used techniques is monocular depth estimation where the depth map is inferred from a single image. This paper improves the self supervised deep learning techniques to perform accurate generalized monocular depth estimation. The main idea is to train the deep model to take into account a sequence of the different frames, each frame is geotagged with its location information. This makes the model able to enhance depth estimation given area semantics. We demonstrate the effectiveness of our model to improve depth estimation results. The model is trained in a realistic environment and the results show improvements in the depth map after adding the location data to the model training phase.


Neural network approaches for solving Schr "odinger equation in arbitrary quantum wells. In this work we approach the Schr "odinger equation in quantum wells with arbitrary potentials, using the machine learning technique. Two neural networks with different architectures are proposed and trained using a set of potentials, energies, and wave functions previously generated with the classical finite element method. Three accuracy indicators have been proposed for testing the estimates given by the neural networks. The networks are trained by the gradient descent method and the training validation is done with respect to a large training data set. The two networks are then tested for two different potential data sets and the results are compared. Several cases with analytical potential have also been solved.


Bi incomplete Tambara functors. For an equivariant commutative ring spectrum R , pi 0 R has algebraic structure reflecting the presence of both additive transfers and multiplicative norms. The additive structure gives rise to a Mackey functor and the multiplicative structure yields the additional structure of a Tambara functor. If R is an N infty ring spectrum in the category of genuine G spectra, then all possible additive transfers are present and pi 0 R has the structure of an incomplete Tambara functor. However, if R is an N infty ring spectrum in a category of incomplete G spectra, the situation is more subtle. In this paper, we study the algebraic theory of Tambara structures on incomplete Mackey functors, which we call bi incomplete Tambara functors. Just as incomplete Tambara functors have compatibility conditions that control which systems of norms are possible, bi incomplete Tambara functors have algebraic constraints arising from the possible interactions of transfers and norms. We give a complete description of the possible interactions between the additive and multiplicative structures.


Egocentric Activity Recognition and Localization on a 3D Map. Given a video captured from a first person perspective and recorded in a familiar environment, can we recognize what the person is doing and identify where the action occurs in the 3D space? We address this challenging problem of jointly recognizing and localizing actions of a mobile user on a known 3D map from egocentric videos. To this end, we propose a novel deep probabilistic model. Our model takes the inputs of a Hierarchical Volumetric Representation (HVR) of the environment and an egocentric video, infers the 3D action location as a latent variable, and recognizes the action based on the video and contextual cues surrounding its potential locations. To evaluate our model, we conduct extensive experiments on a newly collected egocentric video dataset, in which both human naturalistic actions and photo realistic 3D environment reconstructions are captured. Our method demonstrates strong results on both action recognition and 3D action localization across seen and unseen environments. We believe our work points to an exciting research direction in the intersection of egocentric vision, and 3D scene understanding.


ProtAugment Unsupervised diverse short texts paraphrasing for intent detection meta learning. Recent research considers few shot intent detection as a meta learning problem the model is learning to learn from a consecutive set of small tasks named episodes. In this work, we propose ProtAugment, a meta learning algorithm for short texts classification (the intent detection task). ProtAugment is a novel extension of Prototypical Networks, that limits overfitting on the bias introduced by the few shots classification objective at each episode. It relies on diverse paraphrasing a conditional language model is first fine tuned for paraphrasing, and diversity is later introduced at the decoding stage at each meta learning episode. The diverse paraphrasing is unsupervised as it is applied to unlabelled data, and then fueled to the Prototypical Network training objective as a consistency loss. ProtAugment is the state of the art method for intent detection meta learning, at no extra labeling efforts and without the need to fine tune a conditional language model on a given application domain.


Learning to Segment Rigid Motions from Two Frames. Appearance based detectors achieve remarkable performance on common scenes, but tend to fail for scenarios lack of training data. Geometric motion segmentation algorithms, however, generalize to novel scenes, but have yet to achieve comparable performance to appearance based ones, due to noisy motion estimations and degenerate motion configurations. To combine the best of both worlds, we propose a modular network, whose architecture is motivated by a geometric analysis of what independent object motions can be recovered from an egomotion field. It takes two consecutive frames as input and predicts segmentation masks for the background and multiple rigidly moving objects, which are then parameterized by 3D rigid transformations. Our method achieves state of the art performance for rigid motion segmentation on KITTI and Sintel. The inferred rigid motions lead to a significant improvement for depth and scene flow estimation. At the time of submission, our method ranked 1st on KITTI scene flow leaderboard, out performing the best published method (scene flow error 4.89 vs 6.31 ).


Learning a Universal Template for Few shot Dataset Generalization. Few shot dataset generalization is a challenging variant of the well studied few shot classification problem where a diverse training set of several datasets is given, for the purpose of training an adaptable model that can then learn classes from new datasets using only a few examples. To this end, we propose to utilize the diverse training set to construct a universal template a partial model that can define a wide array of dataset specialized models, by plugging in appropriate components. For each new few shot classification problem, our approach therefore only requires inferring a small number of parameters to insert into the universal template. We design a separate network that produces an initialization of those parameters for each given task, and we then fine tune its proposed initialization via a few steps of gradient descent. Our approach is more parameter efficient, scalable and adaptable compared to previous methods, and achieves the state of the art on the challenging Meta Dataset benchmark.


Improving Aerial Instance Segmentation in the Dark with Self Supervised Low Light Enhancement. Low light conditions in aerial images adversely affect the performance of several vision based applications. There is a need for methods that can efficiently remove the low light attributes and assist in the performance of key vision tasks. In this work, we propose a new method that is capable of enhancing the low light image in a self supervised fashion, and sequentially apply detection and segmentation tasks in an end to end manner. The proposed method occupies a very small overhead in terms of memory and computational power over the original algorithm and delivers superior results. Additionally, we propose the generation of a new low light aerial dataset using GANs, which can be used to evaluate vision based networks for similar adverse conditions.


Beyond Pointwise Submodularity Non Monotone Adaptive Submodular Maximization subject to Knapsack and k System Constraints. In this paper, we study the non monotone adaptive submodular maximization problem subject to a knapsack and a k system constraints. The input of our problem is a set of items, where each item has a particular state drawn from a known prior distribution. However, the state of an item is initially unknown, one must select an item in order to reveal the state of that item. There is a utility function which is defined over items and states. Our objective is to sequentially select a group of items to maximize the expected utility. Although the cardinality constrained non monotone adaptive submodular maximization has been well studied in the literature, whether there exists a constant approximation solution for the knapsack constrained or k system constrained adaptive submodular maximization problem remains an open problem. It fact, it has only been settled given the additional assumption of pointwise submodularity. In this paper, we remove the common assumption on pointwise submodularity and propose the first constant approximation solutions for both cases. Inspired by two recent studies on non monotone adaptive submodular maximization, we develop a sampling based randomized algorithm that achieves a frac 1 10 approximation for the case of a knapsack constraint and that achieves a frac 1 2k 4 approximation ratio for the case of a k system constraint.


Parafermionic bases of standard modules for twisted affine Lie algebras of type A 2l 1 (2) , D l 1 (2) , E 6 (2) and D 4 (3) . Using the bases of principal subspaces for twisted affine Lie algebras except A 2l (2) by Butorac and Sadowski, we construct bases of the highest weight modules of highest weight k Lambda 0 and parafermionic spases for the same affine Lie algebras. As a result, we obtain their character formulas conjectured in arXiv math 0102113.


Profitable Trade Off Between Memory and Performance In Multi Domain Chatbot Architectures. Text classification problem is a very broad field of study in the field of natural language processing. In short, the text classification problem is to determine which of the previously determined classes the given text belongs to. Successful studies have been carried out in this field in the past studies. In the study, Bidirectional Encoder Representations for Transformers (BERT), which is a frequently preferred method for solving the classification problem in the field of natural language processing, is used. By solving classification problems through a single model to be used in a chatbot architecture, it is aimed to alleviate the load on the server that will be created by more than one model used for solving more than one classification problem. At this point, with the masking method applied during the estimation of a single BERT model, which was created for classification in more than one subject, the estimation of the model was provided on a problem based basis. Three separate data sets covering different fields from each other are divided by various methods in order to complicate the problem, and classification problems that are very close to each other in terms of field are also included in this way. The dataset used in this way consists of five classification problems with 154 classes. A BERT model containing all classification problems and other BERT models trained specifically for the problems were compared with each other in terms of performance and the space they occupied on the server.


WLV RIT at GermEval 2021 Multitask Learning with Transformers to Detect Toxic, Engaging, and Fact Claiming Comments. This paper addresses the identification of toxic, engaging, and fact claiming comments on social media. We used the dataset made available by the organizers of the GermEval 2021 shared task containing over 3,000 manually annotated Facebook comments in German. Considering the relatedness of the three tasks, we approached the problem using large pre trained transformer models and multitask learning. Our results indicate that multitask learning achieves performance superior to the more common single task learning approach in all three tasks. We submit our best systems to GermEval 2021 under the team name WLV RIT.


Well posedness and blowup for the dispersion managed nonlinear Schr "odinger equation. We consider the nonlinear Schr "odinger equation with periodic dispersion management. We first establish global in time Strichartz estimates for the underlying linear equation with suitable dispersion maps. As an application, we establish a small data scattering result for the 3d cubic equation. Finally, we use a virial argument to demonstrate the existence of blowup solutions for the 3d cubic equation with piecewise constant dispersion map.


Who Should Go First? A Self Supervised Concept Sorting Model for Improving Taxonomy Expansion. Taxonomies have been widely used in various machine learning and text mining systems to organize knowledge and facilitate downstream tasks. One critical challenge is that, as data and business scope grow in real applications, existing taxonomies need to be expanded to incorporate new concepts. Previous works on taxonomy expansion process the new concepts independently and simultaneously, ignoring the potential relationships among them and the appropriate order of inserting operations. However, in reality, the new concepts tend to be mutually correlated and form local hypernym hyponym structures. In such a scenario, ignoring the dependencies of new concepts and the order of insertion may trigger error propagation. For example, existing taxonomy expansion systems may insert hyponyms to existing taxonomies before their hypernym, leading to sub optimal expanded taxonomies. To complement existing taxonomy expansion systems, we propose TaxoOrder, a novel self supervised framework that simultaneously discovers the local hypernym hyponym structure among new concepts and decides the order of insertion. TaxoOrder can be directly plugged into any taxonomy expansion system and improve the quality of expanded taxonomies. Experiments on the real world dataset validate the effectiveness of TaxoOrder to enhance taxonomy expansion systems, leading to better resulting taxonomies with comparison to baselines under various evaluation metrics.


Training Meta Surrogate Model for Transferable Adversarial Attack. We consider adversarial attacks to a black box model when no queries are allowed. In this setting, many methods directly attack surrogate models and transfer the obtained adversarial examples to fool the target model. Plenty of previous works investigated what kind of attacks to the surrogate model can generate more transferable adversarial examples, but their performances are still limited due to the mismatches between surrogate models and the target model. In this paper, we tackle this problem from a novel angle instead of using the original surrogate models, can we obtain a Meta Surrogate Model (MSM) such that attacks to this model can be easier transferred to other models? We show that this goal can be mathematically formulated as a well posed (bi level like) optimization problem and design a differentiable attacker to make training feasible. Given one or a set of surrogate models, our method can thus obtain an MSM such that adversarial examples generated on MSM enjoy eximious transferability. Comprehensive experiments on Cifar 10 and ImageNet demonstrate that by attacking the MSM, we can obtain stronger transferable adversarial examples to fool black box models including adversarially trained ones, with much higher success rates than existing methods. The proposed method reveals significant security challenges of deep models and is promising to be served as a state of the art benchmark for evaluating the robustness of deep models in the black box setting.


Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks. In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In particular, randomized algorithms are currently having a resurgence, given their generalized elementary approach. By using randomized neural networks, we study distributed classification, which can be employed in situations were data cannot be stored at a central location nor shared. We propose a more efficient solution for distributed classification by making use of a lossy compression approach applied when sharing the local classifiers with other agents. This approach originates from the framework of hyperdimensional computing, and is adapted herein. The results of experiments on a collection of datasets demonstrate that the proposed approach has usually higher accuracy than local classifiers and getting close to the benchmark the centralized classifier. This work can be considered as the first step towards analyzing the variegated horizon of distributed randomized neural networks.


Simulation of Electrospray Emission Processes for Highly Conductive Liquids. An electrohydrodynamic numerical model is used to explore the electrospray emission behavior of both moderate and high electrical conductivity liquids under electrospray conditions. The Volume of Fluid method, incorporating a leaky dielectric model with a charge relaxation consideration, is used to conserve charge to accurately model cone jet formation and droplet breakup. The model is validated against experiments and agrees well with both droplet diameters and charge to mass ratio of emitted progeny droplets. The model examines operating conditions such as flow rate and voltage, with fluid properties also considered, such as surface tension, electrical conductivity, and viscosity for both moderate and high conductivity. For high conductivity and surface tension, the results show that high charge concentration along with the meniscus and convex cone shape results in a higher charge to mass ratio of the emitted droplets while lower conductivity and surface tension tend towards concave cone shapes and lower charge to mass droplets. Recirculation flows inside the bulk liquid are investigated across a range of non dimensional flow rates, and electric Reynolds numbers. For high conductivity liquid emission at the minimum stable flow rate, additional recirculation cells develop near the cone tip suggesting the onset of the axisymmetric instability.


Monte Carlo Methods for Calculating Shapley Shubik Power Index in Weighted Majority Games. This paper addresses Monte Carlo algorithms for calculating the Shapley Shubik power index in weighted majority games. First, we analyze a naive Monte Carlo algorithm and discuss the required number of samples. We then propose an efficient Monte Carlo algorithm and show that our algorithm reduces the required number of samples as compared to the naive algorithm.


Modal decomposition of complex optical fields using convolutional neural networks. Recent studies have shown convolutional neural networks (CNNs) can be trained to perform modal decomposition using intensity images of optical fields. A fundamental limitation of these techniques is that the modal phases can not be uniquely calculated using a single intensity image. The knowledge of modal phases is crucial for wavefront sensing, alignment and mode matching applications. Heterodyne imaging techniques can provide images of the transverse complex amplitude phase profile of laser beams at high resolutions and frame rates. In this work we train a CNN to perform modal decomposition using simulated heterodyne images, allowing the complete modal phases to be predicted. This is to our knowledge the first machine learning decomposition scheme to utilize complex phase information to perform modal decomposition. We compare our network with a traditional overlap integral center of mass centering algorithm and show that it is both less sensitive to beam centering and on average more accurate.


School Virus Infection Simulator for Customizing School Schedules During COVID 19. During the Coronavirus 2019 (the covid 19) pandemic, schools continuously strive to provide consistent education to their students. Teachers and education policymakers are seeking ways to re open schools, as it is necessary for community and economic development. However, in light of the pandemic, schools require customized schedules that can address the health concerns and safety of the students considering classroom sizes, air conditioning equipment, classroom systems, e.g., self contained or compartmentalized. To solve this issue, we developed the School Virus Infection Simulator (SVIS) for teachers and education policymakers. SVIS simulates the spread of infection at a school considering the students' lesson schedules, classroom volume, air circulation rates in classrooms, and infectability of the students. Thus, teachers and education policymakers can simulate how their school schedules can impact current health concerns. We then demonstrate the impact of several school schedules in self contained and departmentalized classrooms and evaluate them in terms of the maximum number of students infected simultaneously and the percentage of face to face lessons. The results show that increasing classroom ventilation rate is effective, however, the impact is not stable compared to customizing school schedules, in addition, school schedules can differently impact the maximum number of students infected depending on whether classrooms are self contained or compartmentalized. It was found that one of school schedules had a higher maximum number of students infected, compared to schedules with a higher percentage of face to face lessons. SVIS and the simulation results can help teachers and education policymakers plan school schedules appropriately in order to reduce the maximum number of students infected, while also maintaining a certain percentage of face to face lessons.


An authentication model based on cryptography. In this paper we proposed an authentication technique based on the user cards, to improve the authentication process in systems that allows remote access for the users, and raise the security rate during an exchange of their messages. in this technique the server performs two functions, the first function, register the users, and give him user ID, PIN code, and user private card contains secrecy information, which is used to encrypt user messages by using two kinds of encryption symmetric using RC4 Pr and asymmetric using RSA encryption., the second function, distribute the user's public card if the user demand that, in which the user sends the own authentication code with their own user ID and recipient user ID to the authentication check, and then the server sends the user public card to the recipient user, thus the sender user can send the messages to recipient user without back to the server again. We attained confidentiality using RC4 Pr and RSA encryption and message authentication, user signature, and mutual secret key by using RSA encryption. in this paper we also implement the proposal in 1 RC4 pr algorithm which is modified to improve the key weakness of basic RC4.


A Family of Multi Asset Automated Market Makers. We present a family of multi asset automated market makers whose liquidity curves are derived from the financial principles of self financing transactions and rebalancing. The constant product market maker emerges as a special case.


Unbiased Graph Embedding with Biased Graph Observations. Graph embedding techniques are pivotal in real world machine learning tasks that operate on graph structured data, such as social recommendation and protein structure modeling. Embeddings are mostly performed on the node level for learning representations of each node. Since the formation of a graph is inevitably affected by certain sensitive node attributes, the node embeddings can inherit such sensitive information and introduce undesirable biases in downstream tasks. Most existing works impose ad hoc constraints on the node embeddings to restrict their distributions for unbiasedness fairness, which however compromise the utility of the resulting embeddings. In this paper, we propose a principled new way for unbiased graph embedding by learning node embeddings from an underlying bias free graph, which is not influenced by sensitive node attributes. Motivated by this new perspective, we propose two complementary methods for uncovering such an underlying graph, with the goal of introducing minimum impact on the utility of the embeddings. Both our theoretical justification and extensive experimental comparisons against state of the art solutions demonstrate the effectiveness of our proposed methods.


Long time dynamics of a competition selection model in the space of measures persistence and concentration. We investigate the long time dynamics of a competition selection model in the case of a continuously distributed initial population. We introduce an epidemic model of pathogen species competing for a single resource, whose efficiency is encoded by a continuous variable (the trait variable'') living in a Euclidean space. The differential equation is solved in a space of measures to allow the observation of the natural concentration of the distribution on specific traits. We show the concentration of the distribution on the maximizing set of the fitness function in the sense of the Kantorovitch Rubinstein metric. When the initial mass of the maximal fitness set is positive, we give a precise description of the convergence of the orbit, including a formula for the asymptotic distribution. We also investigate precisely the case of a finite number of regular global maxima and show that the initial distribution may have an influence on the support of the eventual distribution. In particular, the natural process of competition is not always selecting a unique species, but several species may coexist as long as they maximize the fitness function. In many cases it is possible to compute the eventual distribution of the surviving competitors. In some configurations, species that maximize the fitness may still get extinct depending on the shape of the initial distribution and some other parameter of the model, and we provide a way to characterize when this unexpected extinction happens.


Behavioral Mereology A Modal Logic for Passing Constraints. Mereology is the study of parts and the relationships that hold between them. We introduce a behavioral approach to mereology, in which systems and their parts are known only by the types of behavior they can exhibit. Our discussion is formally topos theoretic, and agnostic to the topos, providing maximal generality however, by using only its internal logic we can hide the details and readers may assume a completely elementary set theoretic discussion. We consider the relationship between various parts of a whole in terms of how behavioral constraints are passed between them, and give an inter modal logic that generalizes the usual alethic modalities in the setting of symmetric accessibility.


Skellam and Time Changed Variants of the Generalized Fractional Counting Process. In this paper, we study a Skellam type variant of the generalized counting process (GCP), namely, the generalized Skellam process. Some of its distributional properties such as the probability mass function, probability generating function, mean, variance and covariance are obtained. Its fractional version, namely, the generalized fractional Skellam process (GFSP) is considered by time changing it with an independent inverse stable subordinator. It is observed that the GFSP is a Skellam type version of the generalized fractional counting process (GFCP) which is a fractional variant of the GCP. It is shown that the one dimensional distributions of the GFSP are not infinitely divisible. An integral representation for its state probabilities is obtained. We establish its long range dependence property by using its variance and covariance structure. Also, we consider two time changed versions of the GFCP. These are obtained by time changing the GFCP by an independent L 'evy subordinator and its inverse. Some particular cases of these time changed processes are discussed by considering specific L 'evy subordinators.


Ramsey simplicity of random graphs. A graph G is q Ramsey for another graph H if in any q edge colouring of G there is a monochromatic copy of H , and the classic Ramsey problem asks for the minimum number of vertices in such a graph. This was broadened in the seminal work of Burr, Erd H o s, and Lov 'asz to the investigation of other extremal parameters of Ramsey graphs, including the minimum degree. It is not hard to see that if G is minimally q Ramsey for H we must have delta(G) ge q( delta(H) 1) 1 , and we say that a graph H is q Ramsey simple if this bound can be attained. Grinshpun showed that this is typical of rather sparse graphs, proving that the random graph G(n,p) is almost surely 2 Ramsey simple when frac log n n ll p ll n 2 3 . In this paper, we explore this question further, asking for which pairs p p(n) and q q(n,p) we can expect G(n,p) to be q Ramsey simple. We resolve the problem for a wide range of values of p and q in particular, we uncover some interesting behaviour when n 2 3 ll p ll n 1 2 .


Flow modules and nowhere zero flows. Let Gamma be a graph, A an abelian group, mathcal D a given orientation of Gamma and R a unital subring of the endomorphism ring of A . It is shown that the set of all maps varphi from E( Gamma) to A such that ( mathcal D , varphi) is an A flow forms a left R module. Let Gamma be a union of two subgraphs Gamma 1 and Gamma 2 , and p n a prime power. It is proved that Gamma admits a nowhere zero p n flow if Gamma 1 and Gamma 2 have at most p n 2 common edges and both have nowhere zero p n flows. More important, it is proved that Gamma admits a nowhere zero 4 flow if Gamma 1 and Gamma 2 both have nowhere zero 4 flows and their common edges induce a connected subgraph of Gamma of size at most 3 . This covers a result of Catlin that a graph admits a nowhere zero 4 flow if it is a union of a 4 cycle and a subgraph admiting a nowhere zero 4 flow.


Consistent ultrafinitist logic. Ultrafinitism postulates that we can only compute on relatively short objects, and numbers beyond certain value are not available. This approach would also forbid many forms of infinitary reasoning and allow to remove certain paradoxes stemming from enumeration theorems. However, philosophers still disagree of whether such a finitist logic would be consistent. We present preliminary work on a proof system based on Curry Howard isomorphism. We also try to present some well known theorems that stop being true in such systems, whereas opposite statements become provable. This approach presents certain impossibility results as logical paradoxes stemming from a profligate use of transfinite reasoning.


Study of a bi axial (KTP) crystal using Double Stokes Mueller Polarimetry. We report the significance of the double Stokes Mueller polarimetry (DSMP) technique, to characterize a large size (3 X 3 X 5mm) KTP (Potassium titanyl phosphate) crystal. The crystal undergoes second harmonic generation with type II phase matching. The study of standard KTP crystal using the DSMP technique helps to validate the efficiency of this technique. We were able to extract the crystal's double Mueller matrix, the relative contribution of the susceptibility tensor components, the phase difference between the susceptibility tensor components, etc. We could determine the crystal axes orientation using this optical technique, which was not possible through a single crystal X Ray diffraction technique for such a large size crystal for which both optic axes and crystallographic axes are the same. Axes direction determined from polarization microscope measurements and Laue diffraction measurements on KTP crystal is compared with those obtained from DSMP measurements.


Residual whiteness principle for automatic parameter selection in ell 2 ell 2 image super resolution problems. We propose an automatic parameter selection strategy for variational image super resolution of blurred and down sampled images corrupted by additive white Gaussian noise (AWGN) with unknown standard deviation. By exploiting particular properties of the operators describing the problem in the frequency domain, our strategy selects the optimal parameter as the one optimising a suitable residual whiteness measure. Numerical tests show the effectiveness of the proposed strategy for generalised ell 2 ell 2 Tikhonov problems.


Monte Carlo Elites Quality Diversity Selection as a Multi Armed Bandit Problem. A core challenge of evolutionary search is the need to balance between exploration of the search space and exploitation of highly fit regions. Quality diversity search has explicitly walked this tightrope between a population's diversity and its quality. This paper extends a popular quality diversity search algorithm, MAP Elites, by treating the selection of parents as a multi armed bandit problem. Using variations of the upper confidence bound to select parents from under explored but potentially rewarding areas of the search space can accelerate the discovery of new regions as well as improve its archive's total quality. The paper tests an indirect measure of quality for parent selection the survival rate of a parent's offspring. Results show that maintaining a balance between exploration and exploitation leads to the most diverse and high quality set of solutions in three different testbeds.


On the Hilbert scheme of linearly normal curves in mathbb P r with small index of speciality. We study the Hilbert scheme mathcal H mathcal L d,g,r parametrizing smooth, irreducible, non degenerate and linearly normal curves of degree d and genus g in mathbb P r whose complete and very ample hyperplane linear series mathcal D have relatively small index of speciality i( mathcal D ) g d r . In particular we show the existence (and non existence as well in some sporadic cases) of every Hilbert scheme of linearly normal curves with i( mathcal D ) 4 . We also determine the irreducibility of mathcal H mathcal L 2r 4,r 8,r for 3 le r le 8 , which are rather peculiar families in a certain sense.


FLAME Taming Backdoors in Federated Learning. Federated Learning (FL) is a collaborative machine learning approach allowing participants to jointly train a model without having to share their private, potentially sensitive local datasets with others. Despite its benefits, FL is vulnerable to so called backdoor attacks, in which an adversary injects manipulated model updates into the federated model aggregation process so that the resulting model will provide targeted false predictions for specific adversary chosen inputs. Proposed defenses against backdoor attacks based on detecting and filtering out malicious model updates consider only very specific and limited attacker models, whereas defenses based on differential privacy inspired noise injection significantly deteriorate the benign performance of the aggregated model. To address these deficiencies, we introduce FLAME, a defense framework that estimates the sufficient amount of noise to be injected to ensure the elimination of backdoors. To minimize the required amount of noise, FLAME uses a model clustering and weight clipping approach. This ensures that FLAME can maintain the benign performance of the aggregated model while effectively eliminating adversarial backdoors. Our evaluation of FLAME on several datasets stemming from application areas including image classification, word prediction, and IoT intrusion detection demonstrates that FLAME removes backdoors effectively with a negligible impact on the benign performance of the models.


Segmentation and ABCD rule extraction for skin tumors classification. During the last years, computer vision based diagnosis systems have been widely used in several hospitals and dermatology clinics, aiming at the early detection of malignant melanoma tumor, which is among the most frequent types of skin cancer. In this work, we present an automated diagnosis system based on the ABCD rule used in clinical diagnosis in order to discriminate benign from malignant skin lesions. First, to reduce the influence of small structures, a preprocessing step based on morphological and fast marching schemes is used. In the second step, an unsupervised approach for lesion segmentation is proposed. Iterative thresholding is applied to initialize level set automatically. As the detection of an automated border is an important step for the correctness of subsequent phases in the computerized melanoma recognition systems, we compare its accuracy with growcut and mean shift algorithms, and discuss how these results may influence in the following steps the feature extraction and the final lesion classification. Relying on visual diagnosis four features Asymmetry (A), Border (B), Color (C) and Diversity (D) are computed and used to construct a classification module based on artificial neural network for the recognition of malignant melanoma. This framework has been tested on a dermoscopic database 16 of 320 images. The classification results show an increasing true detection rate and a decreasing false positive rate.


Uncovering the socioeconomic structure of spatial and social interactions in cities. The relationship between urban mobility, social networks and socioeconomic status is complex and difficult to apprehend, notably due to the lack of data. Here we use mobile phone data to analyze the socioeconomic structure of spatial and social interaction in the Chilean's urban system. Based on the concept of geographical and social events, we develop a methodology to assess the level of spatial and social interactions between locations according to their socioeconomic status. We demonstrate that people with the same socioeconomic status preferentially interact with locations and people with a similar socioeconomic status. We also show that this proximity varies similarly for both spatial and social interactions during the course of the week. Finally, we highlight that these preferential interactions appear to be holding when considering city city interactions.


L 'evy area without approximation. We give asymptotic estimations on the area of the sets of points with large Brownian winding, and study the average winding between a planar Brownian motion and a Poisson point process of large intensity on the plane. This allows us to give a new definition of the L 'evy area which does not rely on approximations of the Brownian path.


Higher Koszul duality and connections with n hereditary algebras. We establish a connection between two areas of independent interest in representation theory, namely Koszul duality and higher homological algebra. This is done through a generalization of the notion of T Koszul algebras, for which we obtain a higher version of classical Koszul duality. Our approach is motivated by and has applications for n hereditary algebras. In particular, we characterize an important class of n T Koszul algebras of highest degree a in terms of (na 1) representation infinite algebras. As a consequence, we see that an algebra is n representation infinite if and only if its trivial extension is (n 1) Koszul with respect to its degree 0 part. Furthermore, we show that when an n representation infinite algebra is n representation tame, then the bounded derived categories of graded modules over the trivial extension and over the associated (n 1) preprojective algebra are equivalent. In the n representation finite case, we introduce the notion of almost n T Koszul algebras and obtain similar results.


TransWeather Transformer based Restoration of Images Degraded by Adverse Weather Conditions. Removing adverse weather conditions like rain, fog, and snow from images is an important problem in many applications. Most methods proposed in the literature have been designed to deal with just removing one type of degradation. Recently, a CNN based method using neural architecture search (All in One) was proposed to remove all the weather conditions at once. However, it has a large number of parameters as it uses multiple encoders to cater to each weather removal task and still has scope for improvement in its performance. In this work, we focus on developing an efficient solution for the all adverse weather removal problem. To this end, we propose TransWeather, a transformer based end to end model with just a single encoder and a decoder that can restore an image degraded by any weather condition. Specifically, we utilize a novel transformer encoder using intra patch transformer blocks to enhance attention inside the patches to effectively remove smaller weather degradations. We also introduce a transformer decoder with learnable weather type embeddings to adjust to the weather degradation at hand. TransWeather achieves significant improvements across multiple test datasets over both All in One network as well as methods fine tuned for specific tasks. In particular, TransWeather pushes the current state of the art by 6.34 PSNR on the Test1 (rain fog) dataset, 4.93 PSNR on the SnowTest100K L dataset and 3.11 PSNR on the RainDrop test dataset. TransWeather is also validated on real world test images and found to be more effective than previous methods. Implementation code and pre trained weights can be accessed at https github.com jeya maria jose TransWeather .


Privacy preserving and Trusted Threat Intelligence Sharing using Distributed Ledgers. Threat information sharing is considered as one of the proactive defensive approaches for enhancing the overall security of trusted partners. Trusted partner organizations can provide access to past and current cybersecurity threats for reducing the risk of a potential cyberattack the requirements for threat information sharing range from simplistic sharing of documents to threat intelligence sharing. Therefore, the storage and sharing of highly sensitive threat information raises considerable concerns regarding constructing a secure, trusted threat information exchange infrastructure. Establishing a trusted ecosystem for threat sharing will promote the validity, security, anonymity, scalability, latency efficiency, and traceability of the stored information that protects it from unauthorized disclosure. This paper proposes a system that ensures the security principles mentioned above by utilizing a distributed ledger technology that provides secure decentralized operations through smart contracts and provides a privacy preserving ecosystem for threat information storage and sharing regarding the MITRE ATT CK framework.


Efficient loading of thulium atoms in a compact MOT for a transportable optical clock. We report on building of a compact vacuum chamber for spectroscopy of ultracold thulium and trapping of up to 13 million atoms. Compactness is achieved by obviating a classical Zeeman slower section and placing an atomic oven close to a magneto optical trap (MOT), specifically at the distance of 11 cm. In this configuration, we significantly gained in solid angle of an atomic beam, which is affected by MOT laser beams, and reached 1 million atoms loaded directly in the MOT. By exploiting Zeeman like deceleration of atoms with an additional laser beam, we increased the number of trapped atoms to 6 million. Then we gained an extra factor of 2 by tailoring the MOT magnetic field gradient with an additional small magnetic coil. Demonstrated results show great perspective of the developed setup for realizing a compact high performance optical atomic clock based on thulium atoms.


Elastic Link for Binarized Neural Network. Recent work has shown that Binarized Neural Networks (BNNs) are able to greatly reduce computational costs and memory footprints, facilitating model deployment on resource constrained devices. However, in comparison to their full precision counterparts, BNNs suffer from severe accuracy degradation. Research aiming to reduce this accuracy gap has thus far largely focused on specific network architectures with few or no 1x1 convolutional layers, for which standard binarization methods do not work well. Because 1x1 convolutions are common in the design of modern architectures (e.g. GoogleNet, ResNet, DenseNet), it is crucial to develop a method to binarize them effectively for BNNs to be more widely adopted. In this work, we propose an "Elastic Link" (EL) module to enrich information flow within a BNN by adaptively adding real valued input features to the subsequent convolutional output features. The proposed EL module is easily implemented and can be used in conjunction with other methods for BNNs. We demonstrate that adding EL to BNNs produces a significant improvement on the challenging large scale ImageNet dataset. For example, we raise the top 1 accuracy of binarized ResNet26 from 57.9 to 64.0 . EL also aids convergence in the training of binarized MobileNet, for which a top 1 accuracy of 56.4 is achieved. Finally, with the integration of ReActNet, it yields a new state of the art result of 71.9 top 1 accuracy.


Technology Developments in Touch Based Accessible Graphics A Systematic Review of Research 2010 2020. This paper presents a systematic literature review of 292 publications from 97 unique venues on touch based graphics for people who are blind or have low vision, from 2010 to mid 2020. It is the first review of its kind on touch based accessible graphics. It is timely because it allows us to assess the impact of new technologies such as commodity 3D printing and low cost electronics on the production and presentation of accessible graphics. As expected our review shows an increase in publications from 2014 that we can attribute to these developments. It also reveals the need to broaden application areas, especially to the workplace broaden end user participation throughout the full design process and conduct more in situ evaluation. This work is linked to an online living resource to be shared with the wider community.


Visual analogy Deep learning versus compositional models. Is analogical reasoning a task that must be learned to solve from scratch by applying deep learning models to massive numbers of reasoning problems? Or are analogies solved by computing similarities between structured representations of analogs? We address this question by comparing human performance on visual analogies created using images of familiar three dimensional objects (cars and their subregions) with the performance of alternative computational models. Human reasoners achieved above chance accuracy for all problem types, but made more errors in several conditions (e.g., when relevant subregions were occluded). We compared human performance to that of two recent deep learning models (Siamese Network and Relation Network) directly trained to solve these analogy problems, as well as to that of a compositional model that assesses relational similarity between part based representations. The compositional model based on part representations, but not the deep learning models, generated qualitative performance similar to that of human reasoners.


Analytical and numerical investigation on the tempered time fractional operator with application to the Bloch equation and the two layered problem. In the continuous time random walk model, the time fractional operator usually expresses an infinite waiting time probability density. Different from that usual setting, this work considers the tempered time fractional operator, which reflects a finite waiting time probability density. Firstly, we analyse the solution of a tempered benchmark problem, which shows a weak singularity near the initial time. The L1 scheme on graded mesh and the WSGL formula with correction terms are adapted to deal with the non smooth solution, in which we compare these two methods systematically in terms of the convergence and consumed CPU time. Furthermore, a fast calculation for the time tempered Caputo fractional derivative is developed based on a sum of exponentials approximation, which significantly reduces the running time. Moreover, the tempered operator is applied to the Bloch equation in nuclear magnetic resonance and a two layered problem with composite material exhibiting distinct memory effects, for which both the analytical (or semi analytical) and numerical solutions are derived using transform techniques and finite difference methods. Data fitting results verify that the tempered time fractional model is much effective to describe the MRI data. An important finding is that, compared with the fractional index, the tempered operator parameter could further accelerate the diffusion. The tempered model with two parameters alpha and rho are more flexible, which can avoid choosing a too small fractional index leading to low regularity and strong heterogeneity.


An Adaptive Framework for Learning Unsupervised Depth Completion. We present a method to infer a dense depth map from a color image and associated sparse depth measurements. Our main contribution lies in the design of an annealing process for determining co visibility (occlusions, disocclusions) and the degree of regularization to impose on the model. We show that regularization and co visibility are related via the fitness (residual) of model to data and both can be unified into a single framework to improve the learning process. Our method is an adaptive weighting scheme that guides optimization by measuring the residual at each pixel location over each training step for (i) estimating a soft visibility mask and (ii) determining the amount of regularization. We demonstrate the effectiveness our method by applying it to several recent unsupervised depth completion methods and improving their performance on public benchmark datasets, without incurring additional trainable parameters or increase in inference time. Code available at https github.com alexklwong adaframe depth completion.


A flexible split step scheme for MV SDEs. We present an implicit Split Step explicit Euler type Method (dubbed SSM) for the simulation of McKean Vlasov Stochastic Differential Equations (MV SDEs) with drifts of superlinear growth in space, Lipschitz in measure and non constant Lipschitz diffusion coefficient. The scheme is designed to leverage the structure induced by the interacting particle approximation system, including parallel implementation and the solvability of the implicit equation. The scheme attains the classical 1 2 root mean square error (rMSE) convergence rate in stepsize and closes the gap left by 18, "Simulation of McKean Vlasov SDEs with super linear growth" in IMA Journal of Numerical Analysis, 01 2021. draa099 regarding efficient implicit methods and their convergence rate for this class of McKean Vlasov SDEs. A sufficient condition for mean square contractivity of the scheme is presented. Several numerical examples are presented, including a comparative analysis to other known algorithms for this class (Taming and Adaptive time stepping) across parallel and non parallel implementations.


A Taxonomy of Similarity Metrics for Markov Decision Processes. Although the notion of task similarity is potentially interesting in a wide range of areas such as curriculum learning or automated planning, it has mostly been tied to transfer learning. Transfer is based on the idea of reusing the knowledge acquired in the learning of a set of source tasks to a new learning process in a target task, assuming that the target and source tasks are close enough. In recent years, transfer learning has succeeded in making Reinforcement Learning (RL) algorithms more efficient (e.g., by reducing the number of samples needed to achieve the (near )optimal performance). Transfer in RL is based on the core concept of similarity whenever the tasks are similar, the transferred knowledge can be reused to solve the target task and significantly improve the learning performance. Therefore, the selection of good metrics to measure these similarities is a critical aspect when building transfer RL algorithms, especially when this knowledge is transferred from simulation to the real world. In the literature, there are many metrics to measure the similarity between MDPs, hence, many definitions of similarity or its complement distance have been considered. In this paper, we propose a categorization of these metrics and analyze the definitions of similarity proposed so far, taking into account such categorization. We also follow this taxonomy to survey the existing literature, as well as suggesting future directions for the construction of new metrics.


The Dirichlet to Neumann map for a semilinear wave equation on Lorentzian manifolds. We consider the semilinear wave equation Box g u a u 4 0 , a neq 0 , on a Lorentzian manifold (M,g) with timelike boundary. We show that from the knowledge of the Dirichlet to Neumann map one can recover the metric g and the coefficient a up to natural obstructions. Our proof rests on the analysis of the interaction of distorted plane waves together with a scattering control argument, as well as Gaussian beam solutions.


Simplified presentations and embeddings of Demazure modules. For an untwisted affine Lie algebra we prove an embedding of any higher level Demazure module into a tensor product of lower level Demazure modules (e.g. level one in type A) which becomes in the limit (for anti dominant weights) the well known embedding of finite dimensional irreducible modules of the underlying simple Lie algebra into the tensor product of fundamental modules. To achieve this goal, we first simplify the presentation of these modules extending the results of cite CV13 in the mathfrak g stable case. As an application, we propose a crystal theoretic way to find classical decompositions with respect to a maximal semi simple Lie subalgebra by identifying the Demazure crystal as a connected component in the corresponding tensor product of crystals.


LabOR Labeling Only if Required for Domain Adaptive Semantic Segmentation. Unsupervised Domain Adaptation (UDA) for semantic segmentation has been actively studied to mitigate the domain gap between label rich source data and unlabeled target data. Despite these efforts, UDA still has a long way to go to reach the fully supervised performance. To this end, we propose a Labeling Only if Required strategy, LabOR, where we introduce a human in the loop approach to adaptively give scarce labels to points that a UDA model is uncertain about. In order to find the uncertain points, we generate an inconsistency mask using the proposed adaptive pixel selector and we label these segment based regions to achieve near supervised performance with only a small fraction (about 2.2 ) ground truth points, which we call "Segment based Pixel Labeling (SPL)". To further reduce the efforts of the human annotator, we also propose "Point based Pixel Labeling (PPL)", which finds the most representative points for labeling within the generated inconsistency mask. This reduces efforts from 2.2 segment label to 40 points label while minimizing performance degradation. Through extensive experimentation, we show the advantages of this new framework for domain adaptive semantic segmentation while minimizing human labor costs.


Chow's Theorem Revisited. We present a proof of Chow's theorem using two results of Errett Bishop retated to volumes and limits of analytic varieties. We think this approach suggested a long time ago in the beautiful book by Gabriel Stolzenberg, is very attractive and easier for students and newcomers to understand, also the theory presented here is linked to areas of mathematics that are not usually associated with Chow's theorem. Furthermore, Bishop's results imply both Chow's and Remmert Stein's theorems directly, meaning that this approach is more economic and just as profound as Remmert Stein's proof. At the end of the paper there is a comparison table that explains how Bishop's theorems generalize to several complex variables classical results of one complex variable.


Towards characterizing the omega 2 fickle recursively enumerable Turing degrees. Given a finite lattice L that can be embedded in the recursively enumerable (r.e.) Turing degrees mathcal R mathrm T , it is not known how one can characterize the degrees mathbf d in mathcal R mathrm T below which L can be bounded. Two important characterizations are of the L 7 and M 3 lattices, where the lattices are bounded below mathbf d if and only if mathbf d contains sets of emph fickleness '' omega and geq omega omega respectively. We work towards finding a lattice that characterizes the levels above omega 2 , the first non trivial level after omega . We considered lattices that are as short'' and narrow'' as L 7 and M 3 , but the lattices characterize also the omega or geq omega omega levels, if the lattices are not already embeddable below all non zero r.e. degrees. We also considered upper semilattices (USLs) by removing the bottom meet(s) of some previously considered lattices, but the removals did not change the levels characterized. This leads us to conjecture that a USL characterizes the same r.e. degrees as the lattice it is based on. We discovered three lattices besides M 3 that also characterize the geq omega omega levels. Our search for a omega 2 candidate therefore involves the lattice theoretic problem of finding lattices that do not contain any of the four geq omega omega lattices as sublattices.


Phyllotaxis inspired Nanosieves with Multiplexed Orbital Angular Momentum. Nanophotonic platforms such as metasurfaces, achieving arbitrary phase profiles within ultrathin thickness, emerge as miniaturized, ultracompact and kaleidoscopic optical vortex generators. However, it is often required to segment or interleave independent subarray metasurfaces to multiplex optical vortices in a single nano device, which in turn affects the compactness and channel capacity of the device. Here, inspired by phyllotaxis patterns in pine cones and sunflowers, we theoretically prove and experimentally report that multiple optical vortices can be produced in a single compact phyllotaxis nanosieve, both in free space and on a chip, where one metaatom may contribute to many vortices simultaneously. The time resolved dynamics of on chip interference wavefronts between multiple plasmonic vortices was revealed by ultrafast time resolved photoemission electron microscopy. Our nature inspired optical vortex generator would facilitate various vortex related optical applications, including structured wavefront shaping, free space and plasmonic vortices, and high capacity information metaphotonics.


Model Order Reduction For Hyperbolic Relaxation Systems. We propose a novel framework for model order reduction of hyperbolic differential equations. The approach combines a relaxation formulation of the hyperbolic equations with a discretization using shifted base functions. Model order reduction techniques are then applied to the resulting system of coupled ordinary differential equations. On computational examples including in particular the case of shock waves we show the validity of the approach and the performance of the reduced system.


Arbitrary Depth Universal Approximation Theorems for Operator Neural Networks. The standard Universal Approximation Theorem for operator neural networks (NNs) holds for arbitrary width and bounded depth. Here, we prove that operator NNs of bounded width and arbitrary depth are universal approximators for continuous nonlinear operators. In our main result, we prove that for non polynomial activation functions that are continuously differentiable at a point with a nonzero derivative, one can construct an operator NN of width five, whose inputs are real numbers with finite decimal representations, that is arbitrarily close to any given continuous nonlinear operator. We derive an analogous result for non affine polynomial activation functions. We also show that depth has theoretical advantages by constructing operator ReLU NNs of depth 2k 3 8 and constant width that cannot be well approximated by any operator ReLU NN of depth k , unless its width is exponential in k .


GraphDF A Discrete Flow Model for Molecular Graph Generation. We consider the problem of molecular graph generation using deep models. While graphs are discrete, most existing methods use continuous latent variables, resulting in inaccurate modeling of discrete graph structures. In this work, we propose GraphDF, a novel discrete latent variable model for molecular graph generation based on normalizing flow methods. GraphDF uses invertible modulo shift transforms to map discrete latent variables to graph nodes and edges. We show that the use of discrete latent variables reduces computational costs and eliminates the negative effect of dequantization. Comprehensive experimental results show that GraphDF outperforms prior methods on random generation, property optimization, and constrained optimization tasks.


Automated and Explainable Ontology Extension Based on Deep Learning A Case Study in the Chemical Domain. Reference ontologies provide a shared vocabulary and knowledge resource for their domain. Manual construction enables them to maintain a high quality, allowing them to be widely accepted across their community. However, the manual development process does not scale for large domains. We present a new methodology for automatic ontology extension and apply it to the ChEBI ontology, a prominent reference ontology for life sciences chemistry. We trained a Transformer based deep learning model on the leaf node structures from the ChEBI ontology and the classes to which they belong. The model is then capable of automatically classifying previously unseen chemical structures. The proposed model achieved an overall F1 score of 0.80, an improvement of 6 percentage points over our previous results on the same dataset. Additionally, we demonstrate how visualizing the model's attention weights can help to explain the results by providing insight into how the model made its decisions.


A fluid structure instability driven physiomarker for aneurysm growth. Currently, the diagnosis and treatment of an aneurysm are informed by correlative guidelines on its size and growth rate, along with a holistic consideration of associated symptoms and pathologies. However, aneurysms can exhibit significant growth or rupture before these criteria are met conversely, large aneurysms may exceed intervention criteria but remain stable over time. Without methods to evaluate the key factors driving aneurysm development, it is difficult to assign preventative treatment to patients most in need. In this work, we propose a fluid structure instability that may cause blood vessels to dilate and form aneurysms, or induce existing aneurysms to grow significantly. The ab initio framework yields a stability parameter that describes the onset of this "fluttering" of the aortic wall, which may drive or signal the presence of abnormal aortic growth. A retrospective study was conducted with 4D flow MRI data from 117 patients indicated for cardiac imaging and 100 normal subjects recruited prospectively as healthy volunteers. Both cohorts comprised subjects with magnetic resonance imaging (MRI) scans of the full thoracic aorta. The stability parameter was calculated for every subject from the earliest MRI data. For a 72 patient subcohort with at least one follow up imaging exam after the initial MRI scan, the growth of each patient's aneurysm was forecast by the stability parameter and compared to the maximum growth rate observed in follow up as well as any subsequent surgical intervention. A receiving operator characteristic (ROC) curve was used to gauge the stability parameter as a potential diagnostic physiomarker. The area under the curve of the ROC analysis was 0.97. The proposed flutter type instability appears to offer accurate prediction of aneurysm development from patient specific data that can inform precise, targeted management of disease progression.


Adaptive plasticity in the spinal cord can produce reaching from scratch and reproduces motor cortex directional tuning. How dynamic interactions between nervous system regions in mammals performs online motor control remains an unsolved problem. Here we present a new approach using a minimal model comprising spinal cord, sensory and motor cortex, coupled by long connections that are plastic. It succeeds in learning how to perform reaching movements of a planar arm with 6 muscles in several directions from scratch. The model satisfies biological plausibility constraints, like neural implementation, transmission delays, local synaptic learning and continuous online learning. The model can go from motor babbling to reaching arbitrary targets in less than 10 minutes of in silico time. Movements are ataxic, as in a motor system without a cerebellum. As emergent properties, neural populations in motor cortex show directional tuning and oscillatory dynamics, and the spinal cord creates convergent force fields that add linearly. The model is extensible and may eventually lead to complete motor control simulation.


Key Phrase Extraction Applause Prediction. With the increase in content availability over the internet it is very difficult to get noticed. It has become an upmost the priority of the blog writers to get some feedback over their creations to be confident about the impact of their article. We are training a machine learning model to learn popular article styles, in the form of vector space representations using various word embeddings, and their popularity based on claps and tags.


Semirelativistic Choquard equations with singular potentials and general nonlinearities arising from Hartree Fock theory. We are interested in the general Choquard equation begin multline sqrt strut Delta m 2 u mu V(x)u frac mu x u left( int mathbb R N frac F(y,u(y)) x y N alpha , dy right) f(x,u) K (x) u q 2 u end multline under suitable assumptions on the bounded potential (V ) and on the nonlinearity (f ). Our analysis extends recent results by the second and third author on the problem with mu 0 and pure power nonlinearity f(x,u) u p 2 u . We show that, under appropriate assumptions on the potential, whether the ground state does exist or not. Finally, we study the asymptotic behaviour of ground states as mu to 0 .


Sentiment Analysis of Persian English Code mixed Texts. The rapid production of data on the internet and the need to understand how users are feeling from a business and research perspective has prompted the creation of numerous automatic monolingual sentiment detection systems. More recently however, due to the unstructured nature of data on social media, we are observing more instances of multilingual and code mixed texts. This development in content type has created a new demand for code mixed sentiment analysis systems. In this study we collect, label and thus create a dataset of Persian English code mixed tweets. We then proceed to introduce a model which uses BERT pretrained embeddings as well as translation models to automatically learn the polarity scores of these Tweets. Our model outperforms the baseline models that use Na "ive Bayes and Random Forest methods.


Spontaneous Emission of Vector Vortex Beams. Harnessing the spontaneous emission of incoherent quantum emitters is one of the hallmarks of nano optics. Yet, an enduring challenge remains making them emit vector beams, which are complex forms of light associated with fruitful developments in fluorescence imaging, optical trapping and high speed telecommunications. Vector beams are characterized by spatially varying polarization states whose construction requires coherence properties that are typically possessed by lasers but not by photons produced by spontaneous emission. Here, we show a route to weave the spontaneous emission of an ensemble of colloidal quantum dots into vector beams. To this end, we use holographic nanostructures that impart the necessary spatial coherence, polarization and topological properties to the light originating from the emitters. We focus our demonstration on vector vortex beams, which are chiral vector beams carrying non zero orbital angular momentum, and argue that our approach can be extended to other forms of vectorial light.


Reduced order modeling of the fluidic pinball. The fluidic pinball is a geometrically simple flow configuration with three rotating cylinders on the vertex of an equilateral triangle. Yet, it remains physically rich enough to host a range of interacting frequencies and to allow testing of control laws within minutes on a laptop. The system has multiple inputs (the three cylinders can independently rotate around their axis) and multiple outputs (downstream velocity sensors). Investigating the natural flow dynamics, we found that the first unsteady transition undergone by the wake flow, when increasing the Reynolds number, is a Hopf bifurcation leading to the usual time periodic vortex shedding phenomenon, typical of cylinder wake flows, in which the mean flow field preserves axial symmetry. We extract dynamically consistent modes from the flow data in order to built a reduced order model (ROM) of this flow regime. We show that the main dynamical features of the primary Hopf bifurcation can be described by a non trivial lowest order model made of three degrees of freedom.


Compositional modelling of immune response and virus transmission dynamics. Transmission models for infectious diseases are typically formulated in terms of dynamics between individuals or groups with processes such as disease progression or recovery for each individual captured phenomenologically, without reference to underlying biological processes. Furthermore, the construction of these models is often monolithic they don't allow one to readily modify the processes involved or include the new ones, or to combine models at different scales. We show how to construct a simple model of immune response to a respiratory virus and a model of transmission using an easily modifiable set of rules allowing further refining and merging the two models together. The immune response model reproduces the expected response curve of PCR testing for COVID 19 and implies a long tailed distribution of infectiousness reflective of individual heterogeneity. This immune response model, when combined with a transmission model, reproduces the previously reported shift in the population distribution of viral loads along an epidemic trajectory.


A Neural Passage Model for Ad hoc Document Retrieval. Traditional statistical retrieval models often treat each document as a whole. In many cases, however, a document is relevant to a query only because a small part of it contain the targeted information. In this work, we propose a neural passage model (NPM) that uses passage level information to improve the performance of ad hoc retrieval. Instead of using a single window to extract passages, our model automatically learns to weight passages with different granularities in the training process. We show that the passage based document ranking paradigm from previous studies can be directly derived from our neural framework. Also, our experiments on a TREC collection showed that the NPM can significantly outperform the existing passage based retrieval models.


Variant driven multi wave pattern of COVID 19 via a Machine Learning analysis of spike protein mutations. Applying a ML approach to the temporal variability of the Spike protein sequence enables us to identify, classify and track emerging virus variants. Our analysis is unbiased, in the sense that it does not require any prior knowledge of the variant characteristics, and our results are validated by other informed methods that define variants based on the complete genome. Furthermore, correlating persistent variants of our approach to epidemiological data, we discover that each new wave of the COVID 19 pandemic is driven and dominated by a new emerging variant. Our results are therefore indispensable for further studies on the evolution of SARS CoV 2 and the prediction of evolutionary patterns that determine current and future mutations of the Spike proteins, as well as their diversification and persistence during the viral spread. Moreover, our ML algorithm works as an efficient early warning system for the emergence of new persistent variants that may pose a threat of triggering a new wave of COVID 19. Capable of a timely identification of potential new epidemiological threats when the variant only represents 1 of the new sequences, our ML strategy is a crucial tool for decision makers to define short and long term strategies to curb future outbreaks. The same methodology can be applied to other viral diseases, influenza included, if sufficient sequencing data is available.


Flavours of Sequential Information Flow. Information flow policies prescribe which information is available to a given user or subsystem. We study the problem of specifying such properties in reactive systems, which may require dynamic changes in information flow restrictions between their states. We formalize several flavours of sequential information flow, which cover different assumptions about the semantic relation between multiple observations of a system. Information flow specification falls into the category of hyperproperties. We define different variants of sequential information flow specification using a first order logic with both trace quantifiers and temporal quantifiers called Hypertrace Logic. We prove that HyperLTL, equivalent to a subset of Hypertrace Logic with restricted quantifier prefixes, cannot specify the majority of the studied two state independence variants. For our results, we introduce a notion of equivalence between sets of traces that cannot be distinguished by certain classes of formulas in Hypertrace Logic. This presents a new approach to proving inexpressiveness results for logics such as HyperLTL.


Figurative Language in Recognizing Textual Entailment. We introduce a collection of recognizing textual entailment (RTE) datasets focused on figurative language. We leverage five existing datasets annotated for a variety of figurative language simile, metaphor, and irony and frame them into over 12,500 RTE examples.We evaluate how well state of the art models trained on popular RTE datasets capture different aspects of figurative language. Our results and analyses indicate that these models might not sufficiently capture figurative language, struggling to perform pragmatic inference and reasoning about world knowledge. Ultimately, our datasets provide a challenging testbed for evaluating RTE models.


Looking Twice for Partial Clues Weakly supervised Part Mentored Attention Network for Vehicle Re Identification. Vehicle re identification (Re ID) is to retrieve images of the same vehicle across different cameras. Two key challenges lie in the subtle inter instance discrepancy caused by near duplicate identities and the large intra instance variance caused by different views. Since the holistic appearance suffers from viewpoint variation and distortion, part level feature learning has been introduced to enhance vehicle description. However, existing approaches to localize and amplify significant parts often fail to handle spatial misalignment as well as occlusion and require expensive annotations. In this paper, we propose a weakly supervised Part Mentored Attention Network (PMANet) composed of a Part Attention Network (PANet) for vehicle part localization with self attention and a Part Mentored Network (PMNet) for mentoring the global and local feature aggregation. Firstly, PANet is introduced to predict a foreground mask and pinpoint K prominent vehicle parts only with weak identity supervision. Secondly, we propose a PMNet to learn global and part level features with multi scale attention and aggregate them in K main partial tasks via part transfer. Like humans who first differentiate objects with general information and then observe salient parts for more detailed clues, PANet and PMNet construct a two stage attention structure to perform a coarse to fine search among identities. Finally, we address this Re ID issue as a multi task problem, including global feature learning, identity classification, and part transfer. We adopt Homoscedastic Uncertainty to learn the optimal weighing of different losses. Comprehensive experiments are conducted on two benchmark datasets. Our approach outperforms recent state of the art methods by averagely 2.63 in CMC 1 on VehicleID and 2.2 in mAP on VeRi776. Results on occluded test sets also demonstrate the generalization ability of PMANet.


Finite Horizon LQR Control of Quadrotors on SE 2(3) . This paper considers optimal control of a quadrotor unmanned aerial vehicles (UAV) using the discrete time, finite horizon, linear quadratic regulator (LQR). The state of a quadrotor UAV is represented as an element of the matrix Lie group of double direct isometries, SE 2(3) . The nonlinear system is linearized using a left invariant error about a reference trajectory, leading to an optimal gain sequence that can be calculated offline. The reference trajectory is calculated using the differentially flat properties of the quadrotor. Monte Carlo simulations demonstrate robustness of the proposed control scheme to parametric uncertainty, state estimation error, and initial error. Additionally, when compared to an LQR controller that uses a conventional error definition, the proposed controller demonstrates better performance when initial errors are large.


kEDM A Performance portable Implementation of Empirical Dynamic Modeling using Kokkos. Empirical Dynamic Modeling (EDM) is a state of the art non linear time series analysis framework. Despite its wide applicability, EDM was not scalable to large datasets due to its expensive computational cost. To overcome this obstacle, researchers have attempted and succeeded in accelerating EDM from both algorithmic and implementational aspects. In previous work, we developed a massively parallel implementation of EDM targeting HPC systems (mpEDM). However, mpEDM maintains different backends for different architectures. This design becomes a burden in the increasingly diversifying HPC systems, when porting to new hardware. In this paper, we design and develop a performance portable implementation of EDM based on the Kokkos performance portability framework (kEDM), which runs on both CPUs and GPUs while based on a single codebase. Furthermore, we optimize individual kernels specifically for EDM computation, and use real world datasets to demonstrate up to 5.5 times speedup compared to mpEDM in convergent cross mapping computation.


Universal systole bounds for arithmetic locally symmetric spaces. The systole of a closed Riemannian manifold is the minimal length of a non contractible closed loop. We give a uniform lower bound for the systole for large classes of simple arithmetic locally symmetric orbifolds. We establish new bounds for the translation length of a semisimple element x in SL n(R) in terms of its associated Mahler measure. We use these geometric methods to prove the existence of extensions of number fields in which fixed sets of primes have certain prescribed splitting behavior.


Linearised Reynolds Averaged predictions of secondary currents in turbulent channels with topographic heterogeneity. A rapid predictive tool based on the linearised Reynolds averaged Navier Stokes equations is proposed in this work to investigate secondary currents generated by streamwise independent surface topography modulations in turbulent channel flow. The tool is derived by coupling the Reynolds averaged momentum equation to the Spalart Allmaras transport equation for the turbulent eddy viscosity, using a nonlinear constitutive relation for the Reynolds stresses to capture correctly secondary motions. Linearised equations, describing the steady flow response to arbitrary surface modulations, are derived by assuming that surface modulations are shallow. Since the equations are linear, the superposition principle holds and the flow response induced by an arbitrary modulation can be obtained by combining appropriately the elementary responses obtained over sinusoidal modulations at multiple spanwise length scales. The tool permits a rapid exploration of large parameter spaces characterising structured surface topographies previously examined in the literature. Here, channels with sinusoidal walls and with longitudinal rectangular ridges are considered. For sinusoidal walls, a large response is observed at two spanwise wavelengths scaling in inner and outer units respectively, mirroring the amplification mechanisms in turbulent shear flows observed from transient growth analysis. For longitudinal rectangular ridges, the model suggests that the analysis of the response and the interpretation of the topology of secondary structures is facilitated when the ridge width and the gap between ridges are used instead of other combinations proposed in the literature.


Computing Diverse Sets of High Quality TSP Tours by EAX Based Evolutionary Diversity Optimisation. Evolutionary algorithms based on edge assembly crossover (EAX) constitute some of the best performing incomplete solvers for the well known traveling salesperson problem (TSP). Often, it is desirable to compute not just a single solution for a given problem, but a diverse set of high quality solutions from which a decision maker can choose one for implementation. Currently, there are only a few approaches for computing a diverse solution set for the TSP. Furthermore, almost all of them assume that the optimal solution is known. In this paper, we introduce evolutionary diversity optimisation (EDO) approaches for the TSP that find a diverse set of tours when the optimal tour is known or unknown. We show how to adopt EAX to not only find a high quality solution but also to maximise the diversity of the population. The resulting EAX based EDO approach, termed EAX EDO is capable of obtaining diverse high quality tours when the optimal solution for the TSP is known or unknown. A comparison to existing approaches shows that they are clearly outperformed by EAX EDO.


Computational modelling and data driven homogenisation of knitted membranes. Knitting is an effective technique for producing complex three dimensional surfaces owing to the inherent flexibility of interlooped yarns and recent advances in manufacturing providing better control of local stitch patterns. Fully yarn level modelling of large scale knitted membranes is not feasible. Therefore, we use a two scale homogenisation approach and model the membrane as a Kirchhoff Love shell on the macroscale and as Euler Bernoulli rods on the microscale. The governing equations for both the shell and the rod are discretised with cubic B spline basis functions. For homogenisation we consider only the in plane response of the membrane. The solution of the nonlinear microscale problem requires a significant amount of time due to the large deformations and the enforcement of contact constraints, rendering conventional online computational homogenisation approaches infeasible. To sidestep this problem, we use a pre trained statistical Gaussian Process Regression (GPR) model to map the macroscale deformations to macroscale stresses. During the offline learning phase, the GPR model is trained by solving the microscale problem for a sufficiently rich set of deformation states obtained by either uniform or Sobol sampling. The trained GPR model encodes the nonlinearities and anisotropies present in the microscale and serves as a material model for the membrane response of the macroscale shell. The bending response can be chosen in dependence of the mesh size to penalise the fine out of plane wrinkling of the membrane. After verifying and validating the different components of the proposed approach, we introduce several examples involving membranes subjected to tension and shear to demonstrate its versatility and good performance.


Accurate Grid Keypoint Learning for Efficient Video Prediction. Video prediction methods generally consume substantial computing resources in training and deployment, among which keypoint based approaches show promising improvement in efficiency by simplifying dense image prediction to light keypoint prediction. However, keypoint locations are often modeled only as continuous coordinates, so noise from semantically insignificant deviations in videos easily disrupt learning stability, leading to inaccurate keypoint modeling. In this paper, we design a new grid keypoint learning framework, aiming at a robust and explainable intermediate keypoint representation for long term efficient video prediction. We have two major technical contributions. First, we detect keypoints by jumping among candidate locations in our raised grid space and formulate a condensation loss to encourage meaningful keypoints with strong representative capability. Second, we introduce a 2D binary map to represent the detected grid keypoints and then suggest propagating keypoint locations with stochasticity by selecting entries in the discrete grid space, thus preserving the spatial structure of keypoints in the longterm horizon for better future frame generation. Extensive experiments verify that our method outperforms the state ofthe art stochastic video prediction methods while saves more than 98 of computing resources. We also demonstrate our method on a robotic assisted surgery dataset with promising results. Our code is available at https github.com xjgaocs Grid Keypoint Learning.


An adaptive Origin Destination flows cluster detecting method to identify urban mobility trends. Origin Destination (OD) flow, as an abstract representation of the object s movement or interaction, has been used to reveal the urban mobility and human land interaction pattern. As an important spatial analysis approach, the clustering methods of point events have been extended to OD flows to identify the dominant trends and spatial structures of urban mobility. However, the existing methods for OD flow cluster detecting are limited both in specific spatial scale and the uncertain result due to different parameters setting, which is difficult for complicated OD flows clustering under spatial heterogeneity. To address these limitations, in this paper, we proposed a novel OD flows cluster detecting method based on the OPTICS algorithm which can identify OD flow clusters with various aggregation scales. The method can adaptively determine parameter value from the dataset without prior knowledge and artificial intervention. Experiments indicated that our method outperformed three state of the art methods with more accurate and complete of clusters and less noise. As a case study, our method is applied to identify the potential routes for public transport service settings by detecting OD flow clusters within urban travel data.


Network Module Detection from Multi Modal Node Features with a Greedy Decision Forest for Actionable Explainable AI. Machine learning methods can detect complex relationships between variables, but usually do not exploit domain knowledge. This is a limitation because in many scientific disciplines, such as systems biology, domain knowledge is available in the form of graphs or networks, and its use can improve model performance. We need network based algorithms that are versatile and applicable in many research areas. In this work, we demonstrate subnetwork detection based on multi modal node features using a novel Greedy Decision Forest with inherent interpretability. The latter will be a crucial factor to retain experts and gain their trust in such algorithms. To demonstrate a concrete application example, we focus on bioinformatics, systems biology and particularly biomedicine, but the presented methodology is applicable in many other domains as well. Systems biology is a good example of a field in which statistical data driven machine learning enables the analysis of large amounts of multi modal biomedical data. This is important to reach the future goal of precision medicine, where the complexity of patients is modeled on a system level to best tailor medical decisions, health practices and therapies to the individual patient. Our proposed approach can help to uncover disease causing network modules from multi omics data to better understand complex diseases such as cancer.


Designing Games for Enabling Co creation with Social Agents. Digital tools have long been used for supporting children's creativity. Digital games that allow children to create artifacts and express themselves in a playful environment serve as efficient Creativity Support Tools (or CSTs). Creativity is also scaffolded by social interactions with others in their environment. In our work, we explore the use of game based interactions with a social agent to scaffold children's creative expression as game players. We designed three collaborative games and play tested with 146 5 10 year old children played with the social robot Jibo, which affords three different kinds of creativity verbal creativity, figural creativity and divergent thinking during creative problem solving. In this paper, we reflect on game mechanic practices that we incorporated to design for stimulating creativity in children. These strategies may be valuable to game designers and HCI researchers designing games and social agents for supporting children's creativity.


Payoff landscapes and the robustness of selfish optimization in iterated games. In iterated games, a player can unilaterally exert influence over the outcome through a careful choice of strategy. A powerful class of such "payoff control" strategies was discovered by Press and Dyson in 2012. Their so called "zero determinant" (ZD) strategies allow a player to unilaterally enforce a linear relationship between both players' payoffs. It was subsequently shown that when the slope of this linear relationship is positive, ZD strategies are robustly effective against a selfishly optimizing co player, in that all adapting paths of the selfish player lead to the maximal payoffs for both players (at least when there are certain restrictions on the game parameters). In this paper, we investigate the efficacy of selfish learning against a fixed player in more general settings, for both ZD and non ZD strategies. We first prove that in any symmetric 2x2 game, the selfish player's final strategy must be of a certain form and cannot be fully stochastic. We then show that there are prisoner's dilemma interactions for which the robustness result does not hold when one player uses a fixed ZD strategy with positive slope. We give examples of selfish adapting paths that lead to locally but not globally optimal payoffs, undermining the robustness of payoff control strategies. For non ZD strategies, these pathologies arise regardless of the original restrictions on the game parameters. Our results illuminate the difficulty of implementing robust payoff control and selfish optimization, even in the simplest context of playing against a fixed strategy.


Threshold Rounding for the Standard LP Relaxation of some Geometric Stabbing Problems. In the rectangle stabbing problem, we are given a set cR of axis aligned rectangles in RR 2 , and the objective is to find a minimum cardinality set of horizontal and or vertical lines such that each rectangle is intersected by one of these lines. The standard LP relaxation for this problem is known to have an integrality gap of 2, while a better intergality gap of 1.58.. is known for the special case when cR is a set of horizontal segments. In this paper, we consider two more special cases when cR is a set of horizontal and vertical segments, and when cR is a set of unit squares. We show that the integrality gap of the standard LP relaxation in both cases is stricly less than 2 . Our rounding technique is based on a generalization of the it threshold rounding idea used by Kovaleva and Spieksma (SIAM J. Disc. Math 2006), which may prove useful for rounding the LP relaxations of other geometric covering problems.


Expected Scalarised Returns Dominance A New Solution Concept for Multi Objective Decision Making. In many real world scenarios, the utility of a user is derived from the single execution of a policy. In this case, to apply multi objective reinforcement learning, the expected utility of the returns must be optimised. Various scenarios exist where a user's preferences over objectives (also known as the utility function) are unknown or difficult to specify. In such scenarios, a set of optimal policies must be learned. However, settings where the expected utility must be maximised have been largely overlooked by the multi objective reinforcement learning community and, as a consequence, a set of optimal solutions has yet to be defined. In this paper we address this challenge by proposing first order stochastic dominance as a criterion to build solution sets to maximise expected utility. We also propose a new dominance criterion, known as expected scalarised returns (ESR) dominance, that extends first order stochastic dominance to allow a set of optimal policies to be learned in practice. We then define a new solution concept called the ESR set, which is a set of policies that are ESR dominant. Finally, we define a new multi objective distributional tabular reinforcement learning (MOT DRL) algorithm to learn the ESR set in a multi objective multi armed bandit setting.


Controlling by Showing i Mimic A Video based Method to Control Robotic Arms. A novel concept of vision based intelligent control of robotic arms is developed here in this work. This work enables the controlling of robotic arms motion only with visual inputs, that is, controlling by showing the videos of correct movements. This work can broadly be sub divided into two segments. The first part of this work is to develop an unsupervised vision based method to control robotic arm in 2 D plane, and the second one is with deep CNN in the same task in 3 D plane. The first method is unsupervised, where our aim is to perform mimicking of human arm motion in real time by a manipulator. We developed a network, namely the vision to motion optical network (DON), where the input should be a video stream containing hand movements of human, the the output would be out the velocity and torque information of the hand movements shown in the videos. The output information of the DON is then fed to the robotic arm by enabling it to generate motion according to the real hand videos. The method has been tested with both live stream video feed as well as on recorded video obtained from a monocular camera even by intelligently predicting the trajectory of human hand hand when it gets occluded. This is why the mimicry of the arm incorporates some intelligence to it and becomes intelligent mimic (i mimic). Alongside the unsupervised method another method has also been developed deploying the deep neural network technique with CNN (Convolutional Neural Network) to perform the mimicking, where labelled datasets are used for training. The same dataset, as used in the unsupervised DON based method, is used in the deep CNN method, after manual annotations. Both the proposed methods are validated with off line as well as with on line video datasets in real time. The entire methodology is validated with real time 1 link and simulated n link manipulators alongwith suitable comparisons.


Uryson width of three dimensional mean convex domain with non negative Ricci curvature. We prove that for every three dimensional manifold with nonnegative Ricci curvature and strictly mean convex boundary, there exists a Morse function so that each connected component of its level sets has a uniform diameter bound, which depends only on the lower bound of mean curvature. This gives an upper bound of Uryson 1 width for those three manifolds with boundary.


On the asymptotic Plateau problem in Cartan Hadamard manifolds. In 18 , Labourie defines what he calls the asymptotic Plateau problem for immersed surfaces of constant extrinsic curvature in 3 dimensional Cartan Hadamard manifolds. We present a complete solution of this problem.


Femtosecond Intersystem Crossing in the DNA Nucleobase Cytosine. Ab initio molecular dynamics including non adiabatic and spin orbit couplings on equal footing is used to unravel the deactivation of cytosine after UV light absorption. Intersystem crossing (ISC) is found to compete directly with internal conversion in tens of femtoseconds, thus making cytosine the organic compound with the fastest triplet population calculated so far. It is found that close degeneracy between singlet and triplet states can more than compensate for very small spin orbit couplings, leading to efficient ISC. The femtosecond nature of the intersystem crossing process highlights its importance in photochemistry and challenges the conventional view that large singlet triplet couplings are required for an efficient population flow into triplet states. These findings are important to understand DNA photostability and the photochemistry and dynamics of organic molecules in general.