GKM spaces, and the signed positivity of the nabla operator. We show that the Frobenius character of the equivariant Borel Moore homology of a certain positive GL n version of the unramified affine Springer fiber Z k studied by Goreski, Kottwitz and MacPherson is computed by the matrix coefficients of the nabla k operator, which acts diagonally in the modified Macdonald basis. We do this by relating the combinatorial formula for the nabla k operator we obtained in an earlier paper to the GKM paving of Z k , and we give an algebraic presentation of the above homology as an explicit submodule of the Kostant Kumar nil Hecke algebra. We then study a certain open locus U k subset Z k , and reduce a long standing conjecture of Bergeron, Garsia, Haiman and Tesler, which predicts the sign of the coefficients of the Schur expansion of nabla k , to a vanishing conjecture about the homology groups of U k . The latter conjecture is in turn reduced to a vanishing conjecture for certain open loci of the regular semisimple Hessenberg varieties which are indexed by partial Dyck paths.


White Box Methods for Explanations of Convolutional Neural Networks in Image Classification Tasks. In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However, the decisions made by these networks are not transparent and cannot be directly interpreted by a human. Several approaches have been proposed to explain to understand the reasoning behind a prediction made by a network. In this paper, we propose a topology of grouping these methods based on their assumptions and implementations. We focus primarily on white box methods that leverage the information of the internal architecture of a network to explain its decision. Given the task of image classification and a trained CNN, this work aims to provide a comprehensive and detailed overview of a set of methods that can be used to create explanation maps for a particular image, that assign an importance score to each pixel of the image based on its contribution to the decision of the network. We also propose a further classification of the white box methods based on their implementations to enable better comparisons and help researchers find methods best suited for different scenarios.


Occlusion robust Visual Markerless Bone Tracking for Computer Assisted Orthopaedic Surgery. Conventional computer assisted orthopaedic navigation systems rely on the tracking of dedicated optical markers for patient poses, which makes the surgical workflow more invasive, tedious, and expensive. Visual tracking has recently been proposed to measure the target anatomy in a markerless and effortless way, but the existing methods fail under real world occlusion caused by intraoperative interventions. Furthermore, such methods are hardware specific and not accurate enough for surgical applications. In this paper, we propose a RGB D sensing based markerless tracking method that is robust against occlusion. We design a new segmentation network that features dynamic region of interest prediction and robust 3D point cloud segmentation. As it is expensive to collect large scale training data with occlusion instances, we also propose a new method to create synthetic RGB D images for network training. Experimental results show that our proposed markerless tracking method outperforms recent state of the art approaches by a large margin, especially when an occlusion exists. Furthermore, our method generalises well to new cameras and new target models, including a cadaver, without the need for network retraining. In practice, by using a high quality commercial RGB D camera, our proposed visual tracking method achieves an accuracy of 1 2 degress and 2 4 mm on a model knee, which meets the standard for clinical applications.


Overdetermined elliptic problems in onduloid type domains with general nonlinearities. In this paper, we prove the existence of nontrivial unbounded domains Omega subset mathbb R n 1 ,n geq1 , bifurcating from the straight cylinder B times mathbb R (where B is the unit ball of mathbb R n ), such that the overdetermined elliptic problem begin equation begin cases Delta u f(u) 0 mbox in Omega , u 0 mbox on partial Omega , partial nu u mbox constant mbox on partial Omega , end cases end equation has a positive bounded solution. We will prove such result for a very general class of functions f 0, infty) to mathbb R . Roughly speaking, we only ask that the Dirichlet problem in B admits a nondegenerate solution. The proof uses a local bifurcation argument.


Mader's conjecture for graphs with small connectivity. Mader conjectured that for any tree T of order m , every k connected graph G with minimum degree at least lfloor frac 3k 2 rfloor m 1 contains a subtree T' cong T such that G V(T') is k connected. In this paper, we give a characterization for a subgraph to contain an embedding of a specified tree avoiding some vertex. As a corollary, we confirm Mader's conjecture for k leq3 .


Abstract Operator Systems over the Cone of Positive Semidefinite Matrices. There are several important abstract operator systems with the convex cone of positive semidefinite matrices at the first level. Well known are the operator systems of separable matrices, of positive semidefinite matrices, and of block positive matrices. In terms of maps, these are the operator systems of entanglement breaking, completely positive, and positive linear maps, respectively. But there exist other interesting and less well studied such operator systems, for example those of completely copositive maps, doubly completely positive maps, and decomposable maps, which all play an important role in quantum information theory. We investigate which of these systems is finitely generated, and which admits a finite dimensional realization in the sense of the Choi Effros Theorem. We answer this question for all of the described systems completely. Our main contribution is that decomposable maps form a system which does not admit a finite dimensional realization, though being finitely generated, whereas the system of doubly completely positive maps is not finitely generated, though having a finite dimensional realization. This also implies that there cannot exist a finitary Choi type characterization of doubly completely positive maps.


Extensional Denotational Semantics of Higher Order Probabilistic Programs, Beyond the Discrete Case. We describe a mathematical structure that can give extensional denotational semantics to higher order probabilistic programs. It is not limited to discrete probabilities, and it is compatible with integration in a way the models that have been proposed before are not. It is organised as a model of propositional linear logic in which all the connectives have intuitive probabilistic interpretations. In addition, it has least fixed points for all maps, so it can interpret recursion.


SimCSE Simple Contrastive Learning of Sentence Embeddings. This paper presents SimCSE, a simple contrastive learning framework that greatly advances the state of the art sentence embeddings. We first describe an unsupervised approach, which takes an input sentence and predicts itself in a contrastive objective, with only standard dropout used as noise. This simple method works surprisingly well, performing on par with previous supervised counterparts. We find that dropout acts as minimal data augmentation and removing it leads to a representation collapse. Then, we propose a supervised approach, which incorporates annotated pairs from natural language inference datasets into our contrastive learning framework, by using "entailment" pairs as positives and "contradiction" pairs as hard negatives. We evaluate SimCSE on standard semantic textual similarity (STS) tasks, and our unsupervised and supervised models using BERT base achieve an average of 76.3 and 81.6 Spearman's correlation respectively, a 4.2 and 2.2 improvement compared to previous best results. We also show both theoretically and empirically that contrastive learning objective regularizes pre trained embeddings' anisotropic space to be more uniform, and it better aligns positive pairs when supervised signals are available.


On the Browder Levine Novikov embedding theorems. In this survey we present applications of the ideas of complement and neighborhood in the theory embeddings of manifolds into Euclidean space (in codimension at least three). We describe how the combination of these ideas gives a reduction of embeddability and isotopy problems to algebraic problems. We present a more clarified exposition of the Browder Levine theorem on realization of normal systems. Most of the survey is accessible to non specialists in the theory of embeddings.


Characterizations of approximation properties defined by operator ideals in the predual of weighted Banach spaces of holomorphic functions. In this article, we show that the predual mathcal G w(U) of the weighted space of holomorphic functions has the mathcal I approximation property if and only if E has the mathcal I approximation property, where mathcal I is a suitably chosen operator ideal, and it w is a radial weight defined on a balanced open subset U of a Banach space E .


Explanation Based Human Debugging of NLP Models A Survey. Debugging a machine learning model is hard since the bug usually involves the training data and the learning process. This becomes even harder for an opaque deep learning model if we have no clue about how the model actually works. In this survey, we review papers that exploit explanations to enable humans to give feedback and debug NLP models. We call this problem explanation based human debugging (EBHD). In particular, we categorize and discuss existing work along three dimensions of EBHD (the bug context, the workflow, and the experimental setting), compile findings on how EBHD components affect the feedback providers, and highlight open problems that could be future research directions.


Bilateral Grid Learning for Stereo Matching Networks. Real time performance of stereo matching networks is important for many applications, such as automatic driving, robot navigation and augmented reality (AR). Although significant progress has been made in stereo matching networks in recent years, it is still challenging to balance real time performance and accuracy. In this paper, we present a novel edge preserving cost volume upsampling module based on the slicing operation in the learned bilateral grid. The slicing layer is parameter free, which allows us to obtain a high quality cost volume of high resolution from a low resolution cost volume under the guide of the learned guidance map efficiently. The proposed cost volume upsampling module can be seamlessly embedded into many existing stereo matching networks, such as GCNet, PSMNet, and GANet. The resulting networks are accelerated several times while maintaining comparable accuracy. Furthermore, we design a real time network (named BGNet) based on this module, which outperforms existing published real time deep stereo matching networks, as well as some complex networks on the KITTI stereo datasets. The code is available at https github.com YuhuaXu BGNet.


Fast and Efficient Locomotion via Learned Gait Transitions. We focus on the problem of developing energy efficient controllers for quadrupedal robots. Animals can actively switch gaits at different speeds to lower their energy consumption. In this paper, we devise a hierarchical learning framework, in which distinctive locomotion gaits and natural gait transitions emerge automatically with a simple reward of energy minimization. We use evolutionary strategies (ES) to train a high level gait policy that specifies gait patterns of each foot, while the low level convex MPC controller optimizes the motor commands so that the robot can walk at a desired velocity using that gait pattern. We test our learning framework on a quadruped robot and demonstrate automatic gait transitions, from walking to trotting and to fly trotting, as the robot increases its speed. We show that the learned hierarchical controller consumes much less energy across a wide range of locomotion speed than baseline controllers.


Cross Domain Emotion Recognition using Few Shot Knowledge Transfer. Emotion recognition from text is a challenging task due to diverse emotion taxonomies, lack of reliable labeled data in different domains, and highly subjective annotation standards. Few shot and zero shot techniques can generalize across unseen emotions by projecting the documents and emotion labels onto a shared embedding space. In this work, we explore the task of few shot emotion recognition by transferring the knowledge gained from supervision on the GoEmotions Reddit dataset to the SemEval tweets corpus, using different emotion representation methods. The results show that knowledge transfer using external knowledge bases and fine tuned encoders perform comparably as supervised baselines, requiring minimal supervision from the task dataset.


Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the OR. The fine grained localization of clinicians in the operating room (OR) is a key component to design the new generation of OR support systems. Computer vision models for person pixel based segmentation and body keypoints detection are needed to better understand the clinical activities and the spatial layout of the OR. This is challenging, not only because OR images are very different from traditional vision datasets, but also because data and annotations are hard to collect and generate in the OR due to privacy concerns. To address these concerns, we first study how joint person pose estimation and instance segmentation can be performed on low resolutions images from 1x to 12x. Second, to address the domain shift and the lack of annotations, we propose a novel unsupervised domain adaptation method, called emph AdaptOR , to adapt a model from an emph in the wild labeled source domain to a statistically different unlabeled target domain. We propose to exploit explicit geometric constraints on the different augmentations of the unlabeled target domain image to generate accurate pseudo labels, and using these pseudo labels to train the model on high and low resolution OR images in a emph self training framework. Furthermore, we propose emph disentangled feature normalization to handle the statistically different source and target domain data. Extensive experimental results with detailed ablation studies on the two OR datasets emph MVOR and emph TUM OR test show the effectiveness of our approach against strongly constructed baselines, especially on the low resolution privacy preserving OR images. Finally, we show the generality of our method as a semi supervised learning (SSL) method on the large scale emph COCO dataset, where we achieve comparable results with as few as textbf 1 of labeled supervision against a model trained with 100 labeled supervision.


A patch in time saves nine Methods for the identification of localised dynamical behaviour and lifespans of coherent structures. We develop a transfer operator based method for the detection of coherent structures and their associated lifespans. Characterising the lifespan of coherent structures allows us to identify dynamically meaningful time windows, which may be associated with transient coherent structures in the localised phase space, as well as with time intervals within which these structures experience fundamental changes, such as merging or separation events. The localised transfer operator approach we pursue allows one to explore the fundamental properties of a dynamical system without full knowledge of the dynamics. The algorithms we develop prove useful not only in the simple case of a periodically driven double well potential model, but also in more complex cases generated using the rotating Boussinesq equations.


Central Values of Degree Six L functions The Case of Hilbert Modular Forms. In this paper we give a formula for the central value of the completed L function L(s,Sym 2 g times f) , where f and g are Hilbert newforms, by explicitly computing the local integrals appearing in the refined Gan Gross Prasad conjecture for SL 2 times tilde SL 2 . We also prove the rationality of this value in some special cases and give a conjecture for the general case.


Locality for singular stochastic PDEs. We develop in this note the tools of regularity structures to deal with singular stochastic PDEs that involve non translation invariant differential operators. We describe in particular the renormalised equation for a very large class of spacetime dependent renormalization schemes.


Recognition and Processing of NATOM. In this paper we show how to process the NOTAM (Notice to Airmen) data of the field in civil aviation. The main research contents are as follows 1.Data preprocessing For the original data of the NOTAM, there is a mixture of Chinese and English, and the structure is poor. The original data is cleaned, the Chinese data and the English data are processed separately, word segmentation is completed, and stopping words are removed. Using Glove word vector methods to represent the data for using a custom mapping vocabulary. 2.Decoupling features and classifiers In order to improve the ability of the text classification model to recognize minority samples, the overall model training process is decoupled from the perspective of the algorithm as a whole, divided into two stages of feature learning and classifier learning. The weights of the feature learning stage and the classifier learning stage adopt different strategies to overcome the influence of the head data and tail data of the imbalanced data set on the classification model. Experiments have proved that the use of decoupling features and classifier methods based on the neural network classification model can complete text multi classification tasks in the field of civil aviation, and at the same time can improve the recognition accuracy of the minority samples in the data set.


Improved OOD Generalization via Adversarial Training and Pre training. Recently, learning a model that generalizes well on out of distribution (OOD) data has attracted great attention in the machine learning community. In this paper, after defining OOD generalization via Wasserstein distance, we theoretically show that a model robust to input perturbation generalizes well on OOD data. Inspired by previous findings that adversarial training helps improve input robustness, we theoretically show that adversarially trained models have converged excess risk on OOD data, and empirically verify it on both image classification and natural language understanding tasks. Besides, in the paradigm of first pre training and then fine tuning, we theoretically show that a pre trained model that is more robust to input perturbation provides a better initialization for generalization on downstream OOD data. Empirically, after fine tuning, this better initialized model from adversarial pre training also has better OOD generalization.


Cyclotomic expansions for mathfrak gl N knot invariants via interpolation Macdonald polynomials. In this paper we construct a new basis for the cyclotomic completion of the center of the quantum mathfrak gl N in terms of the interpolation Macdonald polynomials. Then we use a result of Okounkov to provide a dual basis with respect to the quantum Killing form (or Hopf pairing). The main applications are 1) cyclotomic expansions for the mathfrak gl N Reshetikhin Turaev link invariants and the universal mathfrak gl N knot invariant 2) an explicit construction of the unified mathfrak gl N invariants for integral homology 3 spheres using universal Kirby colors. These results generalize those of Habiro for mathfrak sl 2 . In addition, we give a simple proof of the fact that the universal mathfrak gl N invariant of any evenly framed link and the universal mathfrak sl N invariant of any 0 framed algebraically split link are Gamma invariant, where Gamma Y 2Y with the root lattice Y .


Dynamic VAEs with Generative Replay for Continual Zero shot Learning. Continual zero shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero shot and continual learning approaches in real case scenarios when data may come continually with only attributes for a few classes and attributes and features for other classes. Continual learning(CL) suffers from catastrophic forgetting, and zero shot learning(ZSL) models cannot classify objects like state of the art supervised classifiers due to lack of actual data(or features) during training. This paper proposes a novel continual zero shot learning (DVGR CZSL) model that grows in size with each task and uses generative replay to update itself with previously learned classes to avoid forgetting. We demonstrate our hybrid model(DVGR CZSL) outperforms the baselines and is effective on several datasets, i.e., CUB, AWA1, AWA2, and aPY. We show our method is superior in task sequentially learning with ZSL(Zero Shot Learning). We also discuss our results on the SUN dataset.


Stationary Performance Analysis of Grishechkin Processor Sharing Queues An Integral Equation Approach. We compute the stationary performance metrics of a single server M X G 1 queue under a class of generalized processor sharing scheduling policies that are proposed by Grishechkin. This class of processor sharing policies allow service capacities to be allocated to jobs based on the amount of service they attained. In 11 , Grishechkin derives an integral equation that is satisfied by the Laplace transform of the stationary performance metrics under these policies. Our main focus in this paper is to derive the solution to this integral equation. This is achieved through a series of transforms that convert the integral equation into a more tractable form, then solve it. Then we derive approximations to the density functions of the performance metrics through inverting the Laplace transforms. In the last part of the paper, we apply our results to some well known scheduling policies that are either a special case of the Grishechkin processor sharing policies or can be treated as the limits of a sequence Grishechkin processor sharing policies. These examples include the egalitarian processor sharing policy, the discriminatory processor sharing policy, shortest residual processing time first rule, foreground background policy and the time function scheduling policy.


Leveraging Language to Learn Program Abstractions and Search Heuristics. Inductive program synthesis, or inferring programs from examples of desired behavior, offers a general paradigm for building interpretable, robust, and generalizable machine learning systems. Effective program synthesis depends on two key ingredients a strong library of functions from which to build programs, and an efficient search strategy for finding programs that solve a given task. We introduce LAPS (Language for Abstraction and Program Search), a technique for using natural language annotations to guide joint learning of libraries and neurally guided search models for synthesis. When integrated into a state of the art library learning system (DreamCoder), LAPS produces higher quality libraries and improves search efficiency and generalization on three domains string editing, image composition, and abstract reasoning about scenes even when no natural language hints are available at test time.


On Learning Assisted Content Based Secure Image Transmission for Delay Aware Systems with Randomly Distributed Eavesdroppers Extended Version. In this paper, a learning aided content based wireless image transmission scheme is proposed, where a multi antenna aided source wishes to securely deliver an image to a legitimate destination in the presence of randomly distributed eavesdroppers (Eves). We take into account the fact that not all regions of an image have the same importance from the security perspective. Hence, we propose a transmission scheme, where the source employs a hybrid method to realize both the error free data delivery of public regions containing less important pixels and an artificial noise (AN) aided transmission scheme to provide security for the regions containing large amount of information. Moreover, in order to reinforce system's security, fountain based packet delivery is adopted First, the source node encodes image packets into fountain like packets prior to sending them over the air. The secrecy of our proposed scheme will be achieved if the legitimate destination correctly receives the entire image source packets, while conforming to the latency limits of the system, before Eves can obtain the important regions. Accordingly, the secrecy performance of our scheme is characterized by deriving the closed form expression for the quality of security (QoSec) violation probability. Moreover, our proposed wireless image delivery scheme leverages the deep neural network (DNN) and learns to maintain optimized transmission parameters, while achieving a low QoSec violation probability. Simulation results are provided with some useful engineering insights which illustrate that our proposed learning assisted scheme outperforms the state of the arts by achieving considerable gains in terms of security and the delay requirement.


Rank Sort Loss for Object Detection and Instance Segmentation. We propose Rank Sort (RS) Loss, a ranking based loss function to train deep object detection and instance segmentation methods (i.e. visual detectors). RS Loss supervises the classifier, a sub network of these methods, to rank each positive above all negatives as well as to sort positives among themselves with respect to (wrt.) their localisation qualities (e.g. Intersection over Union IoU). To tackle the non differentiable nature of ranking and sorting, we reformulate the incorporation of error driven update with backpropagation as Identity Update, which enables us to model our novel sorting error among positives. With RS Loss, we significantly simplify training (i) Thanks to our sorting objective, the positives are prioritized by the classifier without an additional auxiliary head (e.g. for centerness, IoU, mask IoU), (ii) due to its ranking based nature, RS Loss is robust to class imbalance, and thus, no sampling heuristic is required, and (iii) we address the multi task nature of visual detectors using tuning free task balancing coefficients. Using RS Loss, we train seven diverse visual detectors only by tuning the learning rate, and show that it consistently outperforms baselines e.g. our RS Loss improves (i) Faster R CNN by 3 box AP and aLRP Loss (ranking based baseline) by 2 box AP on COCO dataset, (ii) Mask R CNN with repeat factor sampling (RFS) by 3.5 mask AP ( 7 AP for rare classes) on LVIS dataset and also outperforms all counterparts. Code is available at https github.com kemaloksuz RankSortLoss


Coupled Bunch Instabilities Growth in the Fermilab Booster during Acceleration Cycle. Currently, Fermilab Booster accelerates 4.5E12 protons per pulse (ppp) in 81 bunches from 400 MeV to 8 GeV at 15 Hz to provide beam to multiple HEP experiments and is being upgraded to handle higher beam intensity 6.7E12 ppp at a repetition rate of 20 Hz. In the current mode of operation, we control longitudinal coupled bunch instabilities (LCBI) using combination of passive and active dampers. The issues with LCBI are expected to worsen at higher beam intensities. Here, we would like to investigate at what time in the beam cycle a particular mode is going to originate and how much it contributes at a different time of the acceleration cycle using the collected wall current monitor data from injection to extraction. Also, measure growth rates as a function of beam intensity for some dominant modes. Finally, this paper presents results from the observed LCBI analysis for the highest available beam intensities, unexpected findings, and future plans to mitigate the LCBI at higher beam intensities


One2Set Generating Diverse Keyphrases as a Set. Recently, the sequence to sequence models have made remarkable progress on the task of keyphrase generation (KG) by concatenating multiple keyphrases in a predefined order as a target sequence during training. However, the keyphrases are inherently an unordered set rather than an ordered sequence. Imposing a predefined order will introduce wrong bias during training, which can highly penalize shifts in the order between keyphrases. In this work, we propose a new training paradigm One2Set without predefining an order to concatenate the keyphrases. To fit this paradigm, we propose a novel model that utilizes a fixed set of learned control codes as conditions to generate a set of keyphrases in parallel. To solve the problem that there is no correspondence between each prediction and target during training, we propose a K step target assignment mechanism via bipartite matching, which greatly increases the diversity and reduces the duplication ratio of generated keyphrases. The experimental results on multiple benchmarks demonstrate that our approach significantly outperforms the state of the art methods.


FairFed Enabling Group Fairness in Federated Learning. As machine learning algorithms become increasingly integrated in crucial decision making scenarios, such as healthcare, recruitment, and risk assessment, there have been increasing concerns about the privacy and fairness of such systems. Federated learning has been viewed as a promising solution for collaboratively training of machine learning models among multiple parties while maintaining the privacy of their local data. However, federated learning also poses new challenges in mitigating the potential bias against certain populations (e.g., demographic groups), as this typically requires centralized access to the sensitive information (e.g., race, gender) of each data point. Motivated by the importance and challenges of group fairness in federated learning, in this work, we propose FairFed, a novel algorithm to enhance group fairness via a fairness aware aggregation method, which aims to provide fair model performance across different sensitive groups (e.g., racial, gender groups) while maintaining high utility. This formulation can further provide more flexibility in the customized local debiasing strategies for each client. We build our FairFed algorithm around the secure aggregation protocol of federated learning. When running federated training on widely investigated fairness datasets, we demonstrate that our proposed method outperforms the state of the art fair federated learning frameworks under a high heterogeneous sensitive attribute distribution. We also investigate the performance of FairFed on naturally distributed real life data collected from different geographical locations or departments within an organization.


Model Explainability in Deep Learning Based Natural Language Processing. Machine learning (ML) model explainability has received growing attention, especially in the area related to model risk and regulations. In this paper, we reviewed and compared some popular ML model explainability methodologies, especially those related to Natural Language Processing (NLP) models. We then applied one of the NLP explainability methods Layer wise Relevance Propagation (LRP) to a NLP classification model. We used the LRP method to derive a relevance score for each word in an instance, which is a local explainability. The relevance scores are then aggregated together to achieve global variable importance of the model. Through the case study, we also demonstrated how to apply the local explainability method to false positive and false negative instances to discover the weakness of a NLP model. These analysis can help us to understand NLP models better and reduce the risk due to the black box nature of NLP models. We also identified some common issues due to the special natures of NLP models and discussed how explainability analysis can act as a control to detect these issues after the model has been trained.


Adding edge dynamics to bipartite random access networks. We consider random access networks with nodes representing transmitter receiver pairs whose signals interfere with each other depending on their vicinity. Data packets arrive at the nodes over time and form queues. The nodes can be either active or inactive a node deactivates at unit rate, while it activates at a rate that depends on its queue length, provided none of its neighbors is active. In order to model the effects of user mobility in wireless networks, we analyze dynamic interference graphs where the edges are allowed to appear and disappear over time. We focus on bipartite graphs and study the transition time between the two states where one part of the network is active and the other part is inactive, in the limit as the queue lengths become large. Depending on the speed of the dynamics, we are able to obtain a rough classification of the effects of the dynamics on the transition time.


Cyclically presented groups as Labelled Oriented Graph groups. We use results concerning the Smith forms of circulant matrices to identify when cyclically presented groups have free abelianisation and so can be Labelled Oriented Graph (LOG) groups. We generalize a theorem of Odoni and Cremona to show that for a fixed defining word, whose corresponding representer polynomial has an irreducible factor that is not cyclotomic and not equal to pm t , there are at most finitely many n for which the corresponding n generator cyclically presented group has free abelianisation. We classify when Campbell and Robertson's generalized Fibonacci groups H(r,n,s) are LOG groups and when the Sieradski groups are LOG groups. We prove that amongst Johnson and Mawdesley's groups of Fibonacci type, the only ones that can be LOG groups are Gilbert Howie groups H(n,m) . We conjecture that if a Gilbert Howie group is a LOG group, then it is a Sieradski group, and prove this in certain cases (in particular, for fixed m , the conjecture can only be false for finitely many n ). We obtain necessary conditions for a cyclically presented group to be a connected LOG group in terms of the representer polynomial and apply them to the Prishchepov groups.


A Survey on Security and Privacy Issues of UAVs. In the 21st century, the industry of drones, also known as Unmanned Aerial Vehicles (UAVs), has witnessed a rapid increase with its large number of airspace users. The tremendous benefits of this technology in civilian applications such as hostage rescue and parcel delivery will integrate smart cities in the future. Nowadays, the affordability of commercial drones expands its usage at a large scale. However, the development of drone technology is associated with vulnerabilities and threats due to the lack of efficient security implementations. Moreover, the complexity of UAVs in software and hardware triggers potential security and privacy issues. Thus, posing significant challenges for the industry, academia, and governments. In this paper, we extensively survey the security and privacy issues of UAVs by providing a systematic classification at four levels Hardware level, Software level, Communication level, and Sensor level. In particular, for each level, we thoroughly investigate (1) common vulnerabilities affecting UAVs for potential attacks from malicious actors, (2) existing threats that are jeopardizing the civilian application of UAVs, (3) active and passive attacks performed by the adversaries to compromise the security and privacy of UAVs, (4) possible countermeasures and mitigation techniques to protect UAVs from such malicious activities. In addition, we summarize the takeaways that highlight lessons learned about UAVs' security and privacy issues. Finally, we conclude our survey by presenting the critical pitfalls and suggesting promising future research directions for security and privacy of UAVs.


Electron Correlation Nature's Weird and Wonderful Chemical Glue. It can be argued that electron correlation, as a concept, deserves the same prominence in general chemistry as molecular orbital theory. We show how it acts as Nature's "chemical glue" at both the molecular and supramolecular levels. Electron correlation can be presented in a general chemistry course in an at least somewhat intuitive manner. We also propose a simple classification of correlation effects based on their length scales and the size of the orbital gap (relative to the two electron integrals). In the discussion, we also show how DFT can shed light on wavefunction theory, and conversely. We discuss two types of "honorary valence orbitals", one related to small core valence gaps, the other to the ability of empty 3d orbitals in 2nd row elements to act as backbonding acceptors. Finally, we show why the pursuit of absolute total energies for their own sake becomes a sterile exercise, and why atomization energies are a more realistic "fix point".


Quasi collocation based on CCC Schoenberg operators and collocation methods. We propose a collocation and quasi collocation method for solving second order boundary value problems L 2 y f , in which the differential operator L 2 can be represented in the product formulation, aiming mostly on singular and singularly perturbed boundary value problems. Seeking an approximating Canonical Complete Chebyshev spline s by a collocation method leads to demand that L 2s interpolates the function f . On the other hand, in quasi collocation method we require that L 2 s is equal to an approximation of f by the Schoenberg operator. We offer the calculation of both methods based on the Green's function, and give their error bounds.


Deterministic ill posedness and probabilistic well posedness of the viscous nonlinear wave equation describing fluid structure interaction. We study low regularity behavior of the nonlinear wave equation in mathbb R 2 augmented by the viscous dissipative effects described by the Dirichlet Neumann operator. Problems of this type arise in fluid structure interaction where the Dirichlet Neumann operator models the coupling between a viscous, incompressible fluid and an elastic structure. We show that despite the viscous regularization, the Cauchy problem with initial data (u,u t) in H s( mathbb R 2) times H s 1 ( mathbb R 2) , is ill posed whenever 0 s s cr , where the critical exponent s cr depends on the degree of nonlinearity. In particular, for the quintic nonlinearity u 5 , the critical exponent in mathbb R 2 is s cr 1 2 , which is the same as the critical exponent for the associated nonlinear wave equation without the viscous term. We then show that if the initial data is perturbed using a Wiener randomization, which perturbs initial data in the frequency space, then the Cauchy problem for the quintic nonlinear viscous wave equation is well posed almost surely for the supercritical exponents s such that 1 6 s le s cr 1 2 . To the best of our knowledge, this is the first result showing ill posedness and probabilistic well posedness for the nonlinear viscous wave equation arising in fluid structure interaction.


Phase function estimation from a diffuse optical image via deep learning. The phase function is a key element of a light propagation model for Monte Carlo (MC) simulation, which is usually fitted with an analytic function with associated parameters. In recent years, machine learning methods were reported to estimate the parameters of the phase function of a particular form such as the Henyey Greenstein phase function but, to our knowledge, no studies have been performed to determine the form of the phase function. Here we design a convolutional neural network to estimate the phase function from a diffuse optical image without any explicit assumption on the form of the phase function. Specifically, we use a Gaussian mixture model as an example to represent the phase function generally and learn the model parameters accurately. The Gaussian mixture model is selected because it provides the analytic expression of phase function to facilitate deflection angle sampling in MC simulation, and does not significantly increase the number of free parameters. Our proposed method is validated on MC simulated reflectance images of typical biological tissues using the Henyey Greenstein phase function with different anisotropy factors. The effects of field of view (FOV) and spatial resolution on the errors are analyzed to optimize the estimation method. The mean squared error of the phase function is 0.01 and the relative error of the anisotropy factor is 3.28 .


Subverting Stateful Firewalls with Protocol States (Extended Version). We analyzed the generation of protocol header fields in the implementations of multiple TCP IP network stacks and found new ways to leak information about global protocol states. We then demonstrated new covert channels by remotely observing and modifying the system's global state via these protocol fields. Unlike earlier works, our research focuses on hosts that reside in firewalled networks (including source address validation SAV), which is a very common scenario nowadays. Our attacks are designed to be non disruptive in the exfiltration scenario, this makes the attacks stealthier and thus extends their longevity, and in case of host alias resolution and similar techniques this ensures the techniques are ethical. We focused on ICMP, which is commonly served by firewalls, and on UDP, which is forecasted to take a more prominent share of the Internet traffic with the advent of HTTP 3 and QUIC, though we report results for TCP as well. The information leakage scenarios we discovered enable the construction of practical covert channels which directly pierce firewalls, or indirectly establish communication via hosts in firewalled networks that also employ SAV. We describe and test three novel attacks in this context exfiltration via the firewall itself, exfiltration via a DMZ host, and exfiltration via co resident containers. These are three generic, new use cases for covert channels that work around firewalling and enable devices that are not allowed direct communication with the Internet, to still exfiltrate data out of the network. In other words, we exfiltrate data from isolated networks to the Internet. We also explain how to mount known attacks such as host alias resolution, de NATting and container co residence detection, using the new information leakage techniques.


L T p functions on locally compact groups. Let G be a locally compact group and 1 leq p infty . Based on some important earlier works, in this paper the concept of L p T function is introduced. Then the structure of the space L T p(G) , which is consisting of all L p T functions, is investigated. As an important result, L T p(G) is completely characterized, for the class of amenable locally compact groups. Furthermore, it is verified some applications of Plancherel Theorem on L T 2(G) , in the class of abelian locally compact groups.


Translating Human Mobility Forecasting through Natural Language Generation. Existing human mobility forecasting models follow the standard design of the time series prediction model which takes a series of numerical values as input to generate a numerical value as a prediction. Although treating this as a regression problem seems straightforward, incorporating various contextual information such as the semantic category information of each Place of Interest (POI) is a necessary step, and often the bottleneck, in designing an effective mobility prediction model. As opposed to the typical approach, we treat forecasting as a translation problem and propose a novel forecasting through a language generation pipeline. The paper aims to address the human mobility forecasting problem as a language translation task in a sequence to sequence manner. A mobility to language template is first introduced to describe the numerical mobility data as natural language sentences. The core intuition of the human mobility forecasting translation task is to convert the input mobility description sentences into a future mobility description from which the prediction target can be obtained. Under this pipeline, a two branch network, SHIFT (Translating Human Mobility Forecasting), is designed. Specifically, it consists of one main branch for language generation and one auxiliary branch to directly learn mobility patterns. During the training, we develop a momentum mode for better connecting and training the two branches. Extensive experiments on three real world datasets demonstrate that the proposed SHIFT is effective and presents a new revolutionary approach to forecasting human mobility.


What Matters in Learning from Offline Human Demonstrations for Robot Manipulation. Imitating human demonstrations is a promising approach to endow robots with various manipulation capabilities. While recent advances have been made in imitation learning and batch (offline) reinforcement learning, a lack of open source human datasets and reproducible learning methods make assessing the state of the field difficult. In this paper, we conduct an extensive study of six offline learning algorithms for robot manipulation on five simulated and three real world multi stage manipulation tasks of varying complexity, and with datasets of varying quality. Our study analyzes the most critical challenges when learning from offline human data for manipulation. Based on the study, we derive a series of lessons including the sensitivity to different algorithmic design choices, the dependence on the quality of the demonstrations, and the variability based on the stopping criteria due to the different objectives in training and evaluation. We also highlight opportunities for learning from human datasets, such as the ability to learn proficient policies on challenging, multi stage tasks beyond the scope of current reinforcement learning methods, and the ability to easily scale to natural, real world manipulation scenarios where only raw sensory signals are available. We have open sourced our datasets and all algorithm implementations to facilitate future research and fair comparisons in learning from human demonstration data. Codebase, datasets, trained models, and more available at https arise initiative.github.io robomimic web


Well posedness of the Cauchy Problem for the Kinetic DNLS on mathbf T . We consider the Cauchy problem for the kinetic derivative nonlinear Schr "odinger equation on the torus partial t u i partial x 2 u alpha partial x big( u 2 u big) beta partial x big H big( u 2 big) u big , quad (t, x) in 0,T times mathbf T , where the constants alpha, beta are such that alpha in mathbf R and beta 0 , and H denotes the Hilbert transform. This equation has dissipative nature, and the energy method is applicable to prove local well posedness of the Cauchy problem in Sobolev spaces H s for s 3 2 . However, the gauge transform technique, which is useful for dealing with the derivative loss in the nonlinearity when beta 0 , cannot be directly adapted due to the presence of the Hilbert transform. In particular, there has been no result on local well posedness in low regularity spaces or global solvability of the Cauchy problem. In this article, we shall prove local and global well posedness of the Cauchy problem for small initial data in H s( mathbf T ) , s 1 2 . To this end, we make use of the parabolic type smoothing effect arising from the resonant part of the nonlocal nonlinear term beta partial x H( u 2)u , in addition to the usual dispersive type smoothing effect for nonlinear Schr "odinger equations with cubic nonlinearities. As by products of the proof, we also obtain smoothing effect and backward in time ill posedness results.


Machine learning assisted multiscale modeling of composite phase change materials for Li ion batteries thermal management. In this work, we develop a combined convolutional neural networks (CNNs) and finite element method (FEM) to examine the effective thermal properties of composite phase change materials (CPCMs) consisting of paraffin and copper foam. In this approach, first the CPCM microstructures are modeled using FEM and next the image dataset with corresponding thermal properties is created. The image dataset is subsequently used to train and test the CNN performance, which is then compared with the performance of a popular network architecture for image classification tasks. The predicted thermal properties are employed to define the properties of the CPCM material of a battery pack. The heat generation and electrochemical response of a Li ion cell during the charging discharging is simulated by applying Newman battery model. Thermal management is achieved by the latent heat of paraffin, with copper foam for enhancing the thermal conductivity. The multiscale model is finally developed using FEM to investigate the effectiveness of the thermal management of the battery pack. In these models the thermal properties estimated by the FEM and the CNN are employed to define the CPCM materials properties of a battery pack. Our results confirm that the model developed on the basis of a CNN can evaluate the effectiveness of the battery packs thermal management system with an excellent accuracy in comparison with the original FEM models.


SLASH Embracing Probabilistic Circuits into Neural Answer Set Programming. The goal of combining the robustness of neural networks and the expressivity of symbolic methods has rekindled the interest in neuro symbolic AI. Recent advancements in neuro symbolic AI often consider specifically tailored architectures consisting of disjoint neural and symbolic components, and thus do not exhibit desired gains that can be achieved by integrating them into a unifying framework. We introduce SLASH a novel deep probabilistic programming language (DPPL). At its core, SLASH consists of Neural Probabilistic Predicates (NPPs) and logical programs which are united via answer set programming. The probability estimates resulting from NPPs act as the binding element between the logical program and raw input data, thereby allowing SLASH to answer task dependent logical queries. This allows SLASH to elegantly integrate the symbolic and neural components in a unified framework. We evaluate SLASH on the benchmark data of MNIST addition as well as novel tasks for DPPLs such as missing data prediction and set prediction with state of the art performance, thereby showing the effectiveness and generality of our method.


Global Stability and Non Vanishing Vacuum States of 3D Compressible Navier Stokes Equations. We investigate the global stability and non vanishing vacuum states of large solutions to the compressible Navier Stokes equations on the torus mathbb T 3 , and the main novelty of this work is three fold First, under the assumption that the density rho( bf x , t) verifies sup t geq 0 rho(t) L infty leq M , it is shown that the solutions converge to equilibrium state exponentially in L 2 norm. Second, by employing some new thoughts, we also show that the density converges to its equilibrium state exponentially in L infty norm if additionally the initial density rho 0( bf x ) satisfies sup bf x in mathbb T 3 rho 0( bf x ) geq c 0 0 . Finally, we prove that the vacuum states will not vanish for any time provided that the vacuum states are present initially. This phenomenon is totally new and somewhat surprising, and particularly is in contrast to the previous work of H. L. Li et al., Commun. Math. Phys., 281 (2008), 401 444 , where the authors showed that the vacuum states must vanish within finite time for the 1D compressible Navier Stokes equations with density dependent viscosity mu( rho) rho alpha with alpha 1 2 .


Rank of Near Uniform Matrices. A central question in random matrix theory is universality. When an emergent phenomena is observed from a large collection of chosen random variables it is natural to ask if this behavior is specific to the chosen random variable or if the behavior occurs for a larger class of random variables. The rank statistics of random matrices chosen uniformly from operatorname Mat ( mathbf F q) over a finite field are well understood. The universality properties of these statistics are not yet fully understood however. Recently Wood 39 and Maples 26 considered a natural requirement where the random variables are not allowed to be too close to constant and they showed that the rank statistics match with the uniform model up to an error of type e cn . In this paper we explore a condition called near uniform, under which we are able to prove tighter bounds q cn on the asymptotic convergence of the rank statistics. Our method is completely elementary, and allows for a small number of the entries to be deterministic, and for the entries to not be identically distributed so long as they are independent. More importantly, the method also extends to near uniform symmetric, alternating matrices. Our method also applies to two models of perturbations of random matrices sampled uniformly over operatorname GL n( mathbf F q) subtracting the identity or taking a minor of a uniformly sampled invertible matrix.


ZerO Initialization Initializing Residual Networks with only Zeros and Ones. Deep neural networks are usually initialized with random weights, with adequately selected initial variance to ensure stable signal propagation during training. However, there is no consensus on how to select the variance, and this becomes challenging especially as the number of layers grows. In this work, we replace the widely used random weight initialization with a fully deterministic initialization scheme ZerO, which initializes residual networks with only zeros and ones. By augmenting the standard ResNet architectures with a few extra skip connections and Hadamard transforms, ZerO allows us to start the training from zeros and ones entirely. This has many benefits such as improving reproducibility (by reducing the variance over different experimental runs) and allowing network training without batch normalization. Surprisingly, we find that ZerO achieves state of the art performance over various image classification datasets, including ImageNet, which suggests random weights may be unnecessary for modern network initialization.


Eternal Thing 2.0 Analog Trojan Resilient Ripple Less Solar Energy Harvesting System for Sustainable IoT in Smart Cities and Smart Villages. Recently, harvesting natural energy is gaining more attention than other conventional approaches for sustainable Internet of Things (IoT). System on chip (SoC) power requirement for the IoT and generating higher voltages on chip is a massive challenge for on chip peripherals and systems. Many sensors are employed in smart cities and smart villages in decision making, whose power requirement is an issue, and it must be uninterrupted. Previously, we presented Security by Design (SbD) principle to bring energy dissipation and cybersecurity together through our "Eternal Thing". In this paper, an on chip reliable energy harvesting system (EHS) is designed for IoT end node devices which is called "Eternal Thing 2.0". The management section monitors the process load and also the recharging of the battery or super capacitor. An efficient maximum power point tracking (MPPT) algorithm is used to avoid quiescent power consumption. The reliability of the proposed EHS is improved by using an aging tolerant ring oscillator. The proposed EHS is intended and simulated in CMOS 90nm technology. The output voltage is within the vary of 3 3.55V with an input of 1 1.5V. The EHS consumes 22 micro Watt of power, that satisfies the ultra low power necessities of IoT sensible nodes.


Flexible and Explainable Solutions for Multi Agent Path Finding Problems. The multi agent path finding (MAPF) problem is a combinatorial search problem that aims at finding paths for multiple agents (e.g., robots) in an environment (e.g., an autonomous warehouse) such that no two agents collide with each other, and subject to some constraints on the lengths of paths. The real world applications of MAPF require flexibility (e.g., solving variations of MAPF) as well as explainability. In this study, both of these challenges are addressed and some flexible and explainable solutions for MAPF and its variants are introduced.


Analyzing the Use of Character Level Translation with Sparse and Noisy Datasets. This paper provides an analysis of character level machine translation models used in pivot based translation when applied to sparse and noisy datasets, such as crowdsourced movie subtitles. In our experiments, we find that such character level models cut the number of untranslated words by over 40 and are especially competitive (improvements of 2 3 BLEU points) in the case of limited training data. We explore the impact of character alignment, phrase table filtering, bitext size and the choice of pivot language on translation quality. We further compare cascaded translation models to the use of synthetic training data via multiple pivots, and we find that the latter works significantly better. Finally, we demonstrate that neither word nor character BLEU correlate perfectly with human judgments, due to BLEU's sensitivity to length.


Interactive evaluation of operation efficiency of the city's transport system by methods of U statistics. Method of U statistics is used to analyze the efficiency of functioning of the motor transport system of a large city as a complex network system with partially ordered traffic flows. Based on the results of continuous monitoring of movement of the ordered part of flows equipped with GPS trackers, namely, public transport means, methods of interactive, forecasting and aggregated analysis of the state and operation process of motor transport system components of various hierarchy levels have been developed. The proposed technique can be easily automated and used for operational analysis and forecasting of the development of traffic situations on city highways and creation of effective tools to optimize the process of motor transport system functioning.


QCSP on Reflexive Tournaments. We give a complexity dichotomy for the Quantified Constraint Satisfaction Problem QCSP(H) when H is a reflexive tournament. It is well known that reflexive tournaments can be split into a sequence of strongly connected components H 1,...,H n so that there exists an edge from every vertex of H i to every vertex of H j if and only if i j. We prove that if H has both its initial and final strongly connected component (possibly equal) of size 1, then QCSP(H) is in NL and otherwise QCSP(H) is NP hard.


Human like Controllable Image Captioning with Verb specific Semantic Roles. Controllable Image Captioning (CIC) generating image descriptions following designated control signals has received unprecedented attention over the last few years. To emulate the human ability in controlling caption generation, current CIC studies focus exclusively on control signals concerning objective properties, such as contents of interest or descriptive patterns. However, we argue that almost all existing objective control signals have overlooked two indispensable characteristics of an ideal control signal 1) Event compatible all visual contents referred to in a single sentence should be compatible with the described activity. 2) Sample suitable the control signals should be suitable for a specific image sample. To this end, we propose a new control signal for CIC Verb specific Semantic Roles (VSR). VSR consists of a verb and some semantic roles, which represents a targeted activity and the roles of entities involved in this activity. Given a designated VSR, we first train a grounded semantic role labeling (GSRL) model to identify and ground all entities for each role. Then, we propose a semantic structure planner (SSP) to learn human like descriptive semantic structures. Lastly, we use a role shift captioning model to generate the captions. Extensive experiments and ablations demonstrate that our framework can achieve better controllability than several strong baselines on two challenging CIC benchmarks. Besides, we can generate multi level diverse captions easily. The code is available at https github.com mad red VSR guided CIC.


Variational Transformer Networks for Layout Generation. Generative models able to synthesize layouts of different kinds (e.g. documents, user interfaces or furniture arrangements) are a useful tool to aid design processes and as a first step in the generation of synthetic data, among other tasks. We exploit the properties of self attention layers to capture high level relationships between elements in a layout, and use these as the building blocks of the well known Variational Autoencoder (VAE) formulation. Our proposed Variational Transformer Network (VTN) is capable of learning margins, alignments and other global design rules without explicit supervision. Layouts sampled from our model have a high degree of resemblance to the training data, while demonstrating appealing diversity. In an extensive evaluation on publicly available benchmarks for different layout types VTNs achieve state of the art diversity and perceptual quality. Additionally, we show the capabilities of this method as part of a document layout detection pipeline.


SGNet A Super class Guided Network for Image Classification and Object Detection. Most classification models treat different object classes in parallel and the misclassifications between any two classes are treated equally. In contrast, human beings can exploit high level information in making a prediction of an unknown object. Inspired by this observation, the paper proposes a super class guided network (SGNet) to integrate the high level semantic information into the network so as to increase its performance in inference. SGNet takes two level class annotations that contain both super class and finer class labels. The super classes are higher level semantic categories that consist of a certain amount of finer classes. A super class branch (SCB), trained on super class labels, is introduced to guide finer class prediction. At the inference time, we adopt two different strategies Two step inference (TSI) and direct inference (DI). TSI first predicts the super class and then makes predictions of the corresponding finer class. On the other hand, DI directly generates predictions from the finer class branch (FCB). Extensive experiments have been performed on CIFAR 100 and MS COCO datasets. The experimental results validate the proposed approach and demonstrate its superior performance on image classification and object detection.


Image Inpainting via Conditional Texture and Structure Dual Generation. Deep generative approaches have recently made considerable progress in image inpainting by introducing structure priors. Due to the lack of proper interaction with image texture during structure reconstruction, however, current solutions are incompetent in handling the cases with large corruptions, and they generally suffer from distorted results. In this paper, we propose a novel two stream network for image inpainting, which models the structure constrained texture synthesis and texture guided structure reconstruction in a coupled manner so that they better leverage each other for more plausible generation. Furthermore, to enhance the global consistency, a Bi directional Gated Feature Fusion (Bi GFF) module is designed to exchange and combine the structure and texture information and a Contextual Feature Aggregation (CFA) module is developed to refine the generated contents by region affinity learning and multi scale feature aggregation. Qualitative and quantitative experiments on the CelebA, Paris StreetView and Places2 datasets demonstrate the superiority of the proposed method. Our code is available at https github.com Xiefan Guo CTSDG.


Approximate solutions to the Travelling Salesperson Problem on semimetric graphs. With the aid of the relaxed polygonal inequality (introduced by Fagin et al.) we strive to extend the applicability of Christofides approximation technique to the scope of all complete finite weighted graphs with positive weights. First section acquaints the Reader with the class of semimetric graphs and proves that every finite graph admits gamma polygon structure. Sections 2 and 3 establish the necessary notions from the graph and optimization theory to tackle the Traveling Salesperson Problem. In section 4 the minimal spanning tree method is introduced, while section 5 focuses on the analysis of this method through the lens of gamma polygon graphs. The final section of the paper adjusts the technique of Christofides by obtaining frac 3 gamma 2 approximation for the TSP.


Experimental properties of continuously forced, shear driven, stratified turbulence. Part 2. Energetics, anisotropy, parameterisation. In this Part 2 we study further experimental properties of two layer exchange flows in a stratified inclined duct (SID), which are turbulent, strongly stratified, shear driven, and continuously forced. We analyse the same state of the art data sets using the same core shear layer methodology as in Part 1, but we focus here on turbulent energetics and mixing statistics. The detailed analysis of kinetic and scalar energy budgets reveals the specificity and scalings of SID turbulence, while energy spectra provide insight into the current strengths and limitations of our experimental data. The anisotropy of the flow at different scales characterises the turbulent kinetic energy production and dissipation mechanisms of Holmboe waves and turbulence. We then assess standard mixing parameterisations models relying on uniform eddy diffusivities, mixing lengths, flux parameters, buoyancy Reynolds numbers or turbulent Froude numbers, and we compare representative values with the stratified mixing literature. The dependence of these measures of mixing on controllable flow parameters is also elucidated, providing asymptotic estimates that may be extrapolated to more strongly turbulent flows, quantified by the product of the tilt angle of the duct and the Reynolds number. These insights may serve as benchmark for the future generation of experimental data with superior spatio temporal resolution required to probe increasingly vigorous turbulence.


Unsupervised Representations Predict Popularity of Peer Shared Artifacts in an Online Learning Environment. In online collaborative learning environments, students create content and construct their own knowledge through complex interactions over time. To facilitate effective social learning and inclusive participation in this context, insights are needed into the correspondence between student contributed artifacts and their subsequent popularity among peers. In this study, we represent student artifacts by their (a) contextual action logs (b) textual content, and (c) set of instructor specified features, and use these representations to predict artifact popularity measures. Through a mixture of predictive analysis and visual exploration, we find that the neural embedding representation, learned from contextual action logs, has the strongest predictions of popularity, ahead of instructor's knowledge, which includes academic value and creativity ratings. Because this representation can be learnt without extensive human labeling effort, it opens up possibilities for shaping more inclusive student interactions on the fly in collaboration with instructors and students alike.


Fast Nonblocking Persistence for Concurrent Data Structures. We present a fully lock free variant of the recent Montage system for persistent data structures. Our variant, nbMontage, adds persistence to almost any nonblocking concurrent structure without introducing significant overhead or blocking of any kind. Like its predecessor, nbMontage is buffered durably linearizable it guarantees that the state recovered in the wake of a crash will represent a consistent prefix of pre crash execution. Unlike its predecessor, nbMontage ensures wait free progress of the persistence frontier, thereby bounding the number of recent updates that may be lost on a crash, and allowing a thread to force an update of the frontier (i.e., to perform a sync operation) without the risk of blocking. As an extra benefit, the helping mechanism employed by our wait free sync significantly reduces its latency. Performance results for nonblocking queues, skip lists, trees, and hash tables rival custom data structures in the literature dramatically faster than achieved with prior general purpose systems, and generally within 50 of equivalent non persistent structures placed in DRAM.


Learnable Fourier Features for Multi Dimensional Spatial Positional Encoding. Attentional mechanisms are order invariant. Positional encoding is a crucial component to allow attention based deep model architectures such as Transformer to address sequences or images where the position of information matters. In this paper, we propose a novel positional encoding method based on learnable Fourier features. Instead of hard coding each position as a token or a vector, we represent each position, which can be multi dimensional, as a trainable encoding based on learnable Fourier feature mapping, modulated with a multi layer perceptron. The representation is particularly advantageous for a spatial multi dimensional position, e.g., pixel positions on an image, where L 2 distances or more complex positional relationships need to be captured. Our experiments based on several public benchmark tasks show that our learnable Fourier feature representation for multi dimensional positional encoding outperforms existing methods by both improving the accuracy and allowing faster convergence.


Towards Trusted and Intelligent Cyber Physical Systems A Security by Design Approach. The complexity of cyberattacks in Cyber Physical Systems (CPSs) calls for a mechanism that can evaluate the operational behaviour and security without negatively affecting the operation of live systems. In this regard, Digital Twins (DTs) are revolutionizing the CPSs. DTs strengthen the security of CPSs throughout the product lifecycle, while assuming that the DT data is trusted, providing agility to predict and respond to real time changes. However, existing DTs solutions in CPS are constrained with untrustworthy data dissemination among multiple stakeholders and timely course correction. Such limitations reinforce the significance of designing trustworthy distributed solutions with the ability to create actionable insights in real time. To do so, we propose a framework that focuses on trusted and intelligent DT by integrating blockchain and Artificial Intelligence (AI). Following a hybrid approach, the proposed framework not only acquires process knowledge from the specifications of the CPS, but also relies on AI to learn security threats based on sensor data. Furthermore, we integrate blockchain to safeguard product lifecycle data. We discuss the applicability of the proposed framework for the automotive industry as a CPS use case. Finally, we identify the open challenges that impede the implementation of intelligence driven architectures in CPSs.


LIBRA An Economical Hybrid Approach for Cloud Applications with Strict SLAs. Function as a Service (FaaS) has recently emerged to reduce the deployment cost of running cloud applications compared to Infrastructure as a Service (IaaS). FaaS follows a serverless 'pay as you go' computing model it comes at a higher cost per unit of execution time but typically application functions experience lower provisioning time (startup delay). IaaS requires the provisioning of Virtual Machines, which typically suffer from longer cold start delays that cause higher queuing delays and higher request drop rates. We present LIBRA, a balanced (hybrid) approach that leverages both VM based and serverless resources to efficiently manage cloud resources for the applications. LIBRA closely monitors the application demand and provisions appropriate VM and serverless resources such that the running cost is minimized and Service Level Agreements are met. Unlike state of the art, LIBRA not only hides VM cold start delays, and hence reduces response time, by leveraging serverless, but also directs a low rate bursty portion of the demand to serverless where it would be less costly than spinning up new VMs. We evaluate LIBRA on real traces in a simulated environment as well as on the AWS commercial cloud. Our results show that LIBRA outperforms other resource provisioning policies, including a recent hybrid approach LIBRA achieves more than 85 reduction in SLA violations and up to 53 cost savings.


Regularity for quasi linear parabolic equations with nonhomogeneous degeneracy or singularity. We introduce a new class of quasi linear parabolic equations involving nonhomogeneous degeneracy or and singularity partial t u D u q a(x,t) D u s left( Delta u (p 2) left langle D 2 u frac D u D u , frac D u D u right rangle right), where 1 p infty , 1 q leq s infty and a(x,t) ge 0 . The motivation to investigate this model stems not only from the connections to tug of war like stochastic games with noise, but also from the non standard growth problems of double phase type. According to different values of q,s , such equations include nonhomogeneous degeneracy or singularity, and may involve these two features simultaneously. In particular, when q p 2 and q s , it will encompass the parabolic p Laplacian both in divergence form and in non divergence form. We aim to explore the from L infty to C 1, alpha regularity theory for the aforementioned problem. To be precise, under some proper assumptions, we use geometrical methods to establish the local H " o lder regularity of spatial gradients of viscosity solutions.


MHER Model based Hindsight Experience Replay. Solving multi goal reinforcement learning (RL) problems with sparse rewards is generally challenging. Existing approaches have utilized goal relabeling on collected experiences to alleviate issues raised from sparse rewards. However, these methods are still limited in efficiency and cannot make full use of experiences. In this paper, we propose Model based Hindsight Experience Replay (MHER), which exploits experiences more efficiently by leveraging environmental dynamics to generate virtual achieved goals. Replacing original goals with virtual goals generated from interaction with a trained dynamics model leads to a novel relabeling method, model based relabeling (MBR). Based on MBR, MHER performs both reinforcement learning and supervised learning for efficient policy improvement. Theoretically, we also prove the supervised part in MHER, i.e., goal conditioned supervised learning with MBR data, optimizes a lower bound on the multi goal RL objective. Experimental results in several point based tasks and simulated robotics environments show that MHER achieves significantly higher sample efficiency than previous model free and model based multi goal methods.


Biologically Inspired Model for Timed Motion in Robotic Systems. The goal of this work is the development of a motion model for sequentially timed movement actions in robotic systems under specific consideration of temporal stabilization, that is maintaining an approximately constant overall movement time (isochronous behavior). This is demonstrated both in simulation and on a physical robotic system for the task of intercepting a moving target in three dimensional space. Motivated from humanoid motion, timing plays a vital role to generate a naturalistic behavior in interaction with the dynamic environment as well as adaptively planning and executing action sequences on line. In biological systems, many of the physiological and anatomical functions follow a particular level of periodicity and stabilization, which exhibit a certain extent of resilience against external disturbances. A main aspect thereof is stabilizing movement timing against limited perturbations. Especially human arm movement, namely when it is tasked to reach a certain goal point, pose or configuration, shows a stabilizing behavior. This work incorporates the utilization of an extended Kalman filter (EKF) which was implemented to predict the target position while coping with non linear system dynamics. The periodicity and temporal stabilization in biological systems was artificially generated by a Hopf oscillator, yielding a sinusoidal velocity profile for smooth and repeatable motion.


Scalable Graph Neural Network Training The Case for Sampling. Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem becomes even more challenging when scaling to large graphs that exceed the capacity of single devices. Standard approaches to distributed DNN training, such as data and model parallelism, do not directly apply to GNNs. Instead, two different approaches have emerged in the literature whole graph and sample based training. In this paper, we review and compare the two approaches. Scalability is challenging with both approaches, but we make a case that research should focus on sample based training since it is a more promising approach. Finally, we review recent systems supporting sample based training.


Small order asymptotics for nonlinear fractional problems. We study the limiting behavior of solutions to boundary value nonlinear problems involving the fractional Laplacian of order 2s when the parameter s tends to zero. In particular, we show that least energy solutions converge (up to a subsequence) to a nontrivial nonnegative least energy solution of a limiting problem in terms of the logarithmic Laplacian, i.e., the pseudodifferential operator with Fourier symbol ln( xi 2) . These results are motivated by some applications of nonlocal models where a small value for the parameter s yields the optimal choice. Our approach is based on variational methods, uniform energy derived estimates, and the use of a new logarithmic type Sobolev inequality.


Modeling and simulation of nuclear architecture reorganization process using a phase field approach. We develop a special phase field diffusive interface method to model the nuclear architecture reorganization process. In particular, we use a Lagrange multiplier approach in the phase field model to preserve the specific physical and geometrical constraints for the biological events. We develop several efficient and robust linear and weakly nonlinear schemes for this new model. To validate the model and numerical methods, we present ample numerical simulations which in particular reproduce several processes of nuclear architecture reorganization from the experiment literature.


A Study of Mixed Precision Strategies for GMRES on GPUs. Support for lower precision computation is becoming more common in accelerator hardware due to lower power usage, reduced data movement and increased computational performance. However, computational science and engineering (CSE) problems require double precision accuracy in several domains. This conflict between hardware trends and application needs has resulted in a need for mixed precision strategies at the linear algebra algorithms level if we want to exploit the hardware to its full potential while meeting the accuracy requirements. In this paper, we focus on preconditioned sparse iterative linear solvers, a key kernel in several CSE applications. We present a study of mixed precision strategies for accelerating this kernel on an NVIDIA V 100 GPU with a Power 9 CPU. We seek the best methods for incorporating multiple precisions into the GMRES linear solver these include iterative refinement and parallelizable preconditioners. Our work presents strategies to determine when mixed precision GMRES will be effective and to choose parameters for a mixed precision iterative refinement solver to achieve better performance. We use an implementation that is based on the Trilinos library and employs Kokkos Kernels for performance portability of linear algebra kernels. Performance results demonstrate the promise of mixed precision approaches and demonstrate even further improvements are possible by optimizing low level kernels.


Iterated monodromy groups of Chebyshev like maps on mathbb C n . Every affine Weyl group appears as the iterated monodromy group of a Chebyshev like polynomial self map of mathbb C n .


A self supervised learning based 6 DOF grasp planning method for manipulator. To realize a robust robotic grasping system for unknown objects in an unstructured environment, large amounts of grasp data and 3D model data for the object are required, the sizes of which directly affect the rate of successful grasps. To reduce the time cost of data acquisition and labeling and increase the rate of successful grasps, we developed a self supervised learning mechanism to control grasp tasks performed by manipulators. First, a manipulator automatically collects the point cloud for the objects from multiple perspectives to increase the efficiency of data acquisition. The complete point cloud for the objects is obtained by utilizing the hand eye vision of the manipulator, and the TSDF algorithm. Then, the point cloud data for the objects is used to generate a series of six degrees of freedom grasp poses, and the force closure decision algorithm is used to add the grasp quality label to each grasp pose to realize the automatic labeling of grasp data. Finally, the point cloud in the gripper closing area corresponding to each grasp pose is obtained it is then used to train the grasp quality classification model for the manipulator. The results of data acquisition experiments demonstrate that the proposed method allows high quality data to be obtained. The simulated results prove the effectiveness of the proposed grasp data acquisition method. The results of performing actual grasping experiments demonstrate that the proposed self supervised learning method can increase the rate of successful grasps for the manipulator.


Combating small molecule aggregation with machine learning. Biological screens are plagued by false positive hits resulting from aggregation. Thus, methods to triage small colloidally aggregating molecules (SCAMs) are in high demand. Herein, we disclose a bespoke machine learning tool to confidently and intelligibly flag such entities. Our data demonstrate an unprecedented utility of machine learning for predicting SCAMs, achieving 80 of correct predictions in a challenging out of sample validation. The tool outperformed a panel of expert chemists, who correctly predicted 61 7 of the same test molecules in a Turing like test. Further, the computational routine provided insight into molecular features governing aggregation that had remained hidden to expert intuition. Leveraging our tool, we quantify that up to 15 20 of ligands in publicly available chemogenomic databases have the high potential to aggregate at typical screening concentrations, imposing caution in systems biology and drug design programs. Our approach provides a means to augment human intuition, mitigate attrition and a pathway to accelerate future molecular medicine.


Towards Minimax Optimal Best Arm Identification in Linear Bandits. We study the problem of best arm identification in linear bandits in the fixed budget setting. By leveraging properties of the G optimal design and incorporating it into the arm allocation rule, we design a parameter free algorithm, Optimal Design based Linear Best Arm Identification (OD LinBAI). We provide a theoretical analysis of the failure probability of OD LinBAI. While the performances of existing methods (e.g., BayesGap) depend on all the optimality gaps, OD LinBAI depends on the gaps of the top d arms, where d is the effective dimension of the linear bandit instance. Furthermore, we present a minimax lower bound for this problem. The upper and lower bounds show that OD LinBAI is minimax optimal up to multiplicative factors in the exponent. Finally, numerical experiments corroborate our theoretical findings.


Blow up time of strong solutions to a biological network formation model in high space dimensions. We investigate the possible blow up of strong solutions to a biological network formation model originally introduced by D. Cai and D. Hu cite HC . The model is represented by an initial boundary value problem for an elliptic parabolic system with cubic non linearity. We obtain an algebraic equation for the possible blow up time of strong solutions. The equation yields information on how various given data may contribute to the blow up of solutions. As a by product of our development, we establish a W 1,q estimate for solutions to an elliptic equation which shows the explicit dependence of the upper bound on the elliptic coefficients.


Multiple solutions for nonlinear boundary value problems of Kirchhoff type on a double phase setting. This paper deals with some classes of Kirchhoff type problems on a double phase setting and with nonlinear boundary conditions. Under general assumptions, we provide multiplicity results for such problems in the case when the perturbations exhibit a suitable behavior in the origin and at infinity, or when they do not necessarily satisfy the Ambrosetti Rabinowitz condition. To this aim, we combine variational methods, truncation arguments and topological tools.


Rock Hunting With Martian Machine Vision. The Mars Perseverance rover applies computer vision for navigation and hazard avoidance. The challenge to do onboard object recognition highlights the need for low power, customized training, often including low contrast backgrounds. We investigate deep learning methods for the classification and detection of Martian rocks. We report greater than 97 accuracy for binary classifications (rock vs. rover). We fine tune a detector to render geo located bounding boxes while counting rocks. For these models to run on microcontrollers, we shrink and quantize the neural networks' weights and demonstrate a low power rock hunter with faster frame rates (1 frame per second) but lower accuracy (37 ).


On the Robustness of the Integrable Trajectories of the Control Systems with Limited Control Resources. The control system described by Urysohn type integral equation is considered where the system is nonlinear with respect to the phase vector and is affine with respect to the control vector. The control functions are chosen from the closed ball of the space L q left( Omega mathbb R m right), q 1, with radius r and centered at the origin. The trajectory of the system is defined as p integrable multivariable function from the space L p left( Omega mathbb R n right), frac 1 q frac 1 p 1, satisfying the system's equation almost everywhere. It is shown that the system's trajectories are robust with respect to the remaining control resource. Applying this result it is proved that every trajectory can be approximated by the trajectory obtained by full consumption of the total control resource.


Gap at 1 for the percolation threshold of Cayley graphs. We prove that the set of possible values for the percolation threshold p c of Cayley graphs has a gap at 1 in the sense that there exists varepsilon 0 0 such that for every Cayley graph G one either has p c(G) 1 or p c(G) leq 1 varepsilon 0 . The proof builds on the new approach of Duminil Copin, Goswami, Raoufi, Severo Yadin to the existence of phase transition using the Gaussian free field, combined with the finitary version of Gromov's theorem on the structure of groups of polynomial growth of Breuillard, Green Tao.


Learning Invariant Representation with Consistency and Diversity for Semi supervised Source Hypothesis Transfer. Semi supervised domain adaptation (SSDA) aims to solve tasks in target domain by utilizing transferable information learned from the available source domain and a few labeled target data. However, source data is not always accessible in practical scenarios, which restricts the application of SSDA in real world circumstances. In this paper, we propose a novel task named Semi supervised Source Hypothesis Transfer (SSHT), which performs domain adaptation based on source trained model, to generalize well in target domain with a few supervisions. In SSHT, we are facing two challenges (1) The insufficient labeled target data may result in target features near the decision boundary, with the increased risk of mis classification (2) The data are usually imbalanced in source domain, so the model trained with these data is biased. The biased model is prone to categorize samples of minority categories into majority ones, resulting in low prediction diversity. To tackle the above issues, we propose Consistency and Diversity Learning (CDL), a simple but effective framework for SSHT by facilitating prediction consistency between two randomly augmented unlabeled data and maintaining the prediction diversity when adapting model to target domain. Encouraging consistency regularization brings difficulty to memorize the few labeled target data and thus enhances the generalization ability of the learned model. We further integrate Batch Nuclear norm Maximization into our method to enhance the discriminability and diversity. Experimental results show that our method outperforms existing SSDA methods and unsupervised model adaptation methods on DomainNet, Office Home and Office 31 datasets. The code is available at https github.com Wang xd1899 SSHT.


On the Decycling Number of Bubble sort Star Graphs. Bubble sort star graphs are a combination of star graphs and bubble sort graphs. They are bipartite graphs and also form a family of Cayley graphs. The decycling number of a graph is the minimum number of vertices whose removal from the graph results in an acyclic subgraph. In this paper, we prove the decycling number D(n) of an n dimensional bubble sort star graph for n 5. We also show D(n) satisfies the inequalities for n 6.


Identify Apple Leaf Diseases Using Deep Learning Algorithm. Agriculture is an essential industry in the both society and economy of a country. However, the pests and diseases cause a great amount of reduction in agricultural production while there is not sufficient guidance for farmers to avoid this disaster. To address this problem, we apply CNNs to plant disease recognition by building a classification model. Within the dataset of 3,642 images of apple leaves, We use a pre trained image classification model Restnet34 based on a Convolutional neural network (CNN) with the Fastai framework in order to save the training time. Overall, the accuracy of classification is 93.765 .


QAConv Question Answering on Informative Conversations. This paper introduces QAConv, a new question answering (QA) dataset that uses conversations as a knowledge source. We focus on informative conversations, including business emails, panel discussions, and work channels. Unlike open domain and task oriented dialogues, these conversations are usually long, complex, asynchronous, and involve strong domain knowledge. In total, we collect 34,608 QA pairs from 10,259 selected conversations with both human written and machine generated questions. We use a question generator and a dialogue summarizer as auxiliary tools to collect and recommend questions. The dataset has two testing scenarios chunk mode and full mode, depending on whether the grounded partial conversation is provided or retrieved. Experimental results show that state of the art pretrained QA systems have limited zero shot performance and tend to predict our questions as unanswerable. Our dataset provides a new training and evaluation testbed to facilitate QA on conversations research.


Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Dataset. Reasoning over commonsense knowledge bases (CSKB) whose elements are in the form of free text is an important yet hard task in NLP. While CSKB completion only fills the missing links within the domain of the CSKB, CSKB population is alternatively proposed with the goal of reasoning unseen assertions from external resources. In this task, CSKBs are grounded to a large scale eventuality (activity, state, and event) graph to discriminate whether novel triples from the eventuality graph are plausible or not. However, existing evaluations on the population task are either not accurate (automatic evaluation with randomly sampled negative examples) or of small scale (human annotation). In this paper, we benchmark the CSKB population task with a new large scale dataset by first aligning four popular CSKBs, and then presenting a high quality human annotated evaluation set to probe neural models' commonsense reasoning ability. We also propose a novel inductive commonsense reasoning model that reasons over graphs. Experimental results show that generalizing commonsense reasoning on unseen assertions is inherently a hard task. Models achieving high accuracy during training perform poorly on the evaluation set, with a large gap between human performance. We will make the data publicly available for future contributions. Codes and data are available at https github.com HKUST KnowComp CSKB Population.


Coreference Resolution Are the eliminated spans totally worthless?. Various neural based methods have been proposed so far for joint mention detection and coreference resolution. However, existing works on coreference resolution are mainly dependent on filtered mention representation, while other spans are largely neglected. In this paper, we aim at increasing the utilization rate of data and investigating whether those eliminated spans are totally useless, or to what extent they can improve the performance of coreference resolution. To achieve this, we propose a mention representation refining strategy where spans highly related to mentions are well leveraged using a pointer network for representation enhancing. Notably, we utilize an additional loss term in this work to encourage the diversity between entity clusters. Experimental results on the document level CoNLL 2012 Shared Task English dataset show that eliminated spans are indeed much effective and our approach can achieve competitive results when compared with previous state of the art in coreference resolution.


Utilizing Treewidth for Quantitative Reasoning on Epistemic Logic Programs. Extending the popular Answer Set Programming (ASP) paradigm by introspective reasoning capacities has received increasing interest within the last years. Particular attention is given to the formalism of epistemic logic programs (ELPs) where standard rules are equipped with modal operators which allow to express conditions on literals for being known or possible, i.e., contained in all or some answer sets, respectively. ELPs thus deliver multiple collections of answer sets, known as world views. Employing ELPs for reasoning problems so far has mainly been restricted to standard decision problems (complexity analysis) and enumeration (development of systems) of world views. In this paper, we take a next step and contribute to epistemic logic programming in two ways First, we establish quantitative reasoning for ELPs, where the acceptance of a certain set of literals depends on the number (proportion) of world views that are compatible with the set. Second, we present a novel system that is capable of efficiently solving the underlying counting problems required to answer such quantitative reasoning problems. Our system exploits the graph based measure treewidth and works by iteratively finding and refining (graph) abstractions of an ELP program. On top of these abstractions, we apply dynamic programming that is combined with utilizing existing search based solvers like (e)clingo for hard combinatorial subproblems that appear during solving. It turns out that our approach is competitive with existing systems that were introduced recently. This work is under consideration for acceptance in TPLP.


Spectral flow of a localized mode in elastic media. The introduction of structural defects in otherwise periodic media is well known to grant exceptional space control and localization of waves in various physical fields, including elasticity. Despite the variety of designs proposed so far, most of the approaches derive from contextual modifications that do not translate into a design paradigm due to the lack of a general theory. Few exceptions include designs endowed with topological dispersion bands, which, however, require changes over substantial portions of the structure. To overcome these limitations, here we introduce a new rationale based on real space topology to achieve localized modes in continuous elastic media. We theoretically predict and experimentally demonstrate the spectral flow of a localized mode across a bulk frequency gap by modulating a single structural parameter at any chosen location in the structure. The simplicity and generality of this approach opens new avenues in designing wave based devices for energy localization and control.


Parameter efficient Multi task Fine tuning for Transformers via Shared Hypernetworks. State of the art parameter efficient fine tuning methods rely on introducing adapter modules between the layers of a pretrained language model. However, such modules are trained separately for each task and thus do not enable sharing information across tasks. In this paper, we show that we can learn adapter parameters for all layers and tasks by generating them using shared hypernetworks, which condition on task, adapter position, and layer id in a transformer model. This parameter efficient multi task learning framework allows us to achieve the best of both worlds by sharing knowledge across tasks via hypernetworks while enabling the model to adapt to each individual task through task specific adapters. Experiments on the well known GLUE benchmark show improved performance in multi task learning while adding only 0.29 parameters per task. We additionally demonstrate substantial performance improvements in few shot domain generalization across a variety of tasks. Our code is publicly available in https github.com rabeehk hyperformer.


Multi parameter flag Leibniz rules of arbitrary complexity in mixed norm spaces. We prove multi parameter Leibniz rules corresponding to flag paraproducts of arbitrary complexity in mixed norm spaces, including endpoint estimates. The proof relies on multi linear harmonic analysis techniques and a quantitative treatment of the commutators introduced by Bourgain and Li. The argument is robust and applicable to a generic class of multipliers, including (symmetric) Mikhlin multipliers of positive order and asymmetric variants of partial differential operators and Mikhlin multipliers of positive order.